Jul 23 22:22:52.152285 ip-10-0-134-206 systemd[1]: Starting Kubernetes Kubelet... Jul 23 22:22:52.630954 ip-10-0-134-206 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 23 22:22:52.630954 ip-10-0-134-206 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 23 22:22:52.630954 ip-10-0-134-206 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 23 22:22:52.630954 ip-10-0-134-206 kubenswrapper[2575]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 23 22:22:52.630954 ip-10-0-134-206 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 23 22:22:52.630954 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.569823 2575 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 23 22:22:52.630954 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573170 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 22:22:52.630954 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573182 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 22:22:52.630954 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573185 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 22:22:52.630954 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573189 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 22:22:52.630954 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573193 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 22:22:52.630954 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573196 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 22:22:52.630954 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573200 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 22:22:52.632091 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573204 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 22:22:52.632091 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573208 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 22:22:52.632091 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573211 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 22:22:52.632091 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573214 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 22:22:52.632091 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573217 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 22:22:52.632091 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573220 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 22:22:52.632091 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573231 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 22:22:52.632091 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573235 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 22:22:52.632091 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573237 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 22:22:52.632091 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573240 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 22:22:52.632091 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573243 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 22:22:52.632091 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573245 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 22:22:52.632091 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573260 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 22:22:52.632091 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573262 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 22:22:52.632091 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573264 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 22:22:52.632091 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573267 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 22:22:52.632091 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573270 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 22:22:52.632091 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573279 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 22:22:52.632091 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573282 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 22:22:52.632813 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573284 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 22:22:52.632813 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573287 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 22:22:52.632813 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573290 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 22:22:52.632813 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573293 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 22:22:52.632813 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573296 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 22:22:52.632813 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573299 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 22:22:52.632813 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573301 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 22:22:52.632813 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573304 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 22:22:52.632813 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573306 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 22:22:52.632813 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573309 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 22:22:52.632813 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573311 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 22:22:52.632813 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573314 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 22:22:52.632813 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573316 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 22:22:52.632813 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573318 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 22:22:52.632813 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573322 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 22:22:52.632813 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573326 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 22:22:52.632813 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573329 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 22:22:52.632813 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573332 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 22:22:52.632813 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573334 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 22:22:52.633496 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573337 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 22:22:52.633496 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573340 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 22:22:52.633496 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573342 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 22:22:52.633496 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573344 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 22:22:52.633496 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573347 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 22:22:52.633496 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573351 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 22:22:52.633496 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573354 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 22:22:52.633496 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573357 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 22:22:52.633496 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573359 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 22:22:52.633496 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573362 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 22:22:52.633496 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573364 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 22:22:52.633496 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573367 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 22:22:52.633496 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573371 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 22:22:52.633496 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573373 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 22:22:52.633496 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573376 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 22:22:52.633496 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573379 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 22:22:52.633496 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573381 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 22:22:52.633496 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573384 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 22:22:52.633496 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573386 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 22:22:52.633496 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573389 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 22:22:52.634093 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573391 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 22:22:52.634093 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573394 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 22:22:52.634093 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573396 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 22:22:52.634093 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573399 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 22:22:52.634093 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573401 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 22:22:52.634093 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573404 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 22:22:52.634093 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573407 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 22:22:52.634093 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573409 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 22:22:52.634093 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573413 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 22:22:52.634093 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573415 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 22:22:52.634093 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573417 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 23 22:22:52.634093 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573420 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 22:22:52.634093 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573422 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 22:22:52.634093 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573425 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 22:22:52.634093 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573427 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 22:22:52.634093 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573430 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 22:22:52.634093 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573432 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 22:22:52.634093 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573434 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 22:22:52.634093 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573437 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 22:22:52.634093 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573439 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 22:22:52.634783 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573442 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 22:22:52.634783 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573444 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 22:22:52.634783 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573447 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 22:22:52.634783 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573449 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 22:22:52.634783 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573451 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 22:22:52.634783 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573454 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 22:22:52.634783 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573457 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 22:22:52.634783 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573460 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 22:22:52.634783 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573462 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 22:22:52.634783 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573465 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 22:22:52.634783 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573467 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 22:22:52.634783 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573470 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 22:22:52.634783 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573472 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 22:22:52.634783 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.573475 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 22:22:52.634783 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574157 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 22:22:52.634783 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574163 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 22:22:52.634783 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574167 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 22:22:52.634783 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574170 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 22:22:52.634783 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574173 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 22:22:52.634783 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574177 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 22:22:52.635418 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574181 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 22:22:52.635418 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574185 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 22:22:52.635418 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574188 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 22:22:52.635418 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574190 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 22:22:52.635418 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574193 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 22:22:52.635418 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574195 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 22:22:52.635418 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574198 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 22:22:52.635418 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574200 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 23 22:22:52.635418 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574203 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 22:22:52.635418 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574205 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 22:22:52.635418 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574208 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 22:22:52.635418 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574210 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 22:22:52.635418 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574213 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 22:22:52.635418 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574215 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 22:22:52.635418 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574218 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 22:22:52.635418 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574220 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 22:22:52.635418 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574223 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 22:22:52.635418 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574226 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 22:22:52.635418 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574229 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 22:22:52.635940 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574231 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 22:22:52.635940 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574234 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 22:22:52.635940 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574237 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 22:22:52.635940 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574240 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 22:22:52.635940 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574242 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 22:22:52.635940 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574245 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 22:22:52.635940 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574247 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 22:22:52.635940 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574250 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 22:22:52.635940 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574253 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 22:22:52.635940 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574256 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 22:22:52.635940 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574258 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 22:22:52.635940 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574261 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 22:22:52.635940 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574263 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 22:22:52.635940 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574266 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 22:22:52.635940 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574269 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 22:22:52.635940 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574271 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 22:22:52.635940 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574273 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 22:22:52.635940 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574276 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 22:22:52.635940 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574278 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 22:22:52.635940 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574281 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 22:22:52.636577 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574283 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 22:22:52.636577 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574285 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 22:22:52.636577 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574288 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 22:22:52.636577 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574290 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 22:22:52.636577 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574293 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 22:22:52.636577 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574296 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 22:22:52.636577 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574298 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 22:22:52.636577 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574301 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 22:22:52.636577 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574303 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 22:22:52.636577 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574306 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 22:22:52.636577 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574309 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 22:22:52.636577 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574312 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 22:22:52.636577 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574314 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 22:22:52.636577 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574317 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 22:22:52.636577 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574320 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 22:22:52.636577 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574323 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 22:22:52.636577 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574327 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 22:22:52.636577 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574330 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 22:22:52.636577 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574333 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 22:22:52.636577 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574335 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 22:22:52.637124 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574338 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 22:22:52.637124 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574341 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 22:22:52.637124 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574343 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 22:22:52.637124 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574346 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 22:22:52.637124 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574349 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 22:22:52.637124 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574351 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 22:22:52.637124 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574355 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 22:22:52.637124 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574357 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 22:22:52.637124 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574360 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 22:22:52.637124 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574362 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 22:22:52.637124 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574365 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 22:22:52.637124 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574368 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 22:22:52.637124 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574370 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 22:22:52.637124 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574373 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 22:22:52.637124 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574376 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 22:22:52.637124 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574379 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 22:22:52.637124 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574381 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 22:22:52.637124 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574384 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 22:22:52.637124 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574386 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 22:22:52.637124 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574389 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 22:22:52.637944 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574391 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 22:22:52.637944 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574394 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 22:22:52.637944 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574396 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 22:22:52.637944 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574398 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 22:22:52.637944 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574401 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 22:22:52.637944 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574404 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 22:22:52.637944 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574406 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 22:22:52.637944 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574409 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 22:22:52.637944 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574412 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 22:22:52.637944 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574414 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 22:22:52.637944 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574416 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 22:22:52.637944 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574419 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 22:22:52.637944 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574421 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 22:22:52.637944 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574425 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 22:22:52.637944 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574747 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 22:22:52.637944 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574752 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 22:22:52.637944 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574755 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 22:22:52.637944 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574761 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 22:22:52.637944 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574764 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 22:22:52.637944 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574766 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 22:22:52.638509 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574771 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 22:22:52.638509 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574774 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 22:22:52.638509 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574777 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 22:22:52.638509 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574780 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 22:22:52.638509 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574784 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 22:22:52.638509 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574787 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 22:22:52.638509 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574790 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 22:22:52.638509 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574793 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 22:22:52.638509 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574796 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 23 22:22:52.638509 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574799 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 22:22:52.638509 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574802 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 22:22:52.638509 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574805 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 22:22:52.638509 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574808 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 22:22:52.638509 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574811 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 22:22:52.638509 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574813 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 22:22:52.638509 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574816 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 22:22:52.638509 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574818 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 22:22:52.638509 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574821 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 22:22:52.638509 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574823 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 22:22:52.639101 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574826 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 22:22:52.639101 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574828 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 22:22:52.639101 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574831 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 22:22:52.639101 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574833 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 22:22:52.639101 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574836 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 22:22:52.639101 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574838 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 22:22:52.639101 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574841 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 22:22:52.639101 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574843 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 22:22:52.639101 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574846 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 22:22:52.639101 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574849 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 22:22:52.639101 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574852 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 22:22:52.639101 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574855 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 22:22:52.639101 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574858 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 22:22:52.639101 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574860 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 22:22:52.639101 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574862 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 22:22:52.639101 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574865 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 22:22:52.639101 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574867 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 22:22:52.639101 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574870 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 22:22:52.639101 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574872 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 22:22:52.639101 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574875 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 22:22:52.639753 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574877 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 22:22:52.639753 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574880 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 22:22:52.639753 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574882 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 22:22:52.639753 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574884 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 22:22:52.639753 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574887 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 22:22:52.639753 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574889 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 22:22:52.639753 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574892 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 22:22:52.639753 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574894 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 22:22:52.639753 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574896 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 22:22:52.639753 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574899 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 22:22:52.639753 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574902 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 22:22:52.639753 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574904 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 22:22:52.639753 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574908 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 22:22:52.639753 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574911 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 22:22:52.639753 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574913 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 22:22:52.639753 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574915 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 22:22:52.639753 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574918 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 22:22:52.639753 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574920 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 22:22:52.639753 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574923 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 22:22:52.639753 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574925 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 22:22:52.640514 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574927 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 22:22:52.640514 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574930 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 22:22:52.640514 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574933 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 22:22:52.640514 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574936 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 22:22:52.640514 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574938 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 22:22:52.640514 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574941 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 22:22:52.640514 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574943 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 22:22:52.640514 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574946 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 22:22:52.640514 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574948 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 22:22:52.640514 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574950 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 22:22:52.640514 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574954 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 22:22:52.640514 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574956 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 22:22:52.640514 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574958 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 22:22:52.640514 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574962 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 22:22:52.640514 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574965 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 22:22:52.640514 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574968 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 22:22:52.640514 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574970 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 22:22:52.640514 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574973 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 22:22:52.640514 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574975 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 22:22:52.641553 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574977 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 22:22:52.641553 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574980 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 22:22:52.641553 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574982 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 22:22:52.641553 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574985 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 22:22:52.641553 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574987 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 22:22:52.641553 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574991 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 22:22:52.641553 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574993 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 22:22:52.641553 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574996 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 22:22:52.641553 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.574998 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 22:22:52.641553 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575001 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 22:22:52.641553 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575003 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 22:22:52.641553 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575005 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 22:22:52.641553 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575008 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 22:22:52.641553 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575010 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 22:22:52.641553 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575013 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 22:22:52.641553 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575104 2575 flags.go:64] FLAG: --address="0.0.0.0" Jul 23 22:22:52.641553 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575111 2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 23 22:22:52.641553 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575116 2575 flags.go:64] FLAG: --anonymous-auth="true" Jul 23 22:22:52.641553 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575122 2575 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 23 22:22:52.641553 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575126 2575 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 23 22:22:52.641553 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575130 2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 23 22:22:52.641553 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575134 2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 23 22:22:52.642586 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575137 2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 23 22:22:52.642586 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575140 2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 23 22:22:52.642586 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575143 2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 23 22:22:52.642586 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575146 2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 23 22:22:52.642586 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575149 2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 23 22:22:52.642586 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575152 2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 23 22:22:52.642586 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575155 2575 flags.go:64] FLAG: --cgroup-root="" Jul 23 22:22:52.642586 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575158 2575 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 23 22:22:52.642586 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575161 2575 flags.go:64] FLAG: --client-ca-file="" Jul 23 22:22:52.642586 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575163 2575 flags.go:64] FLAG: --cloud-provider="external" Jul 23 22:22:52.642586 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575166 2575 flags.go:64] FLAG: --cluster-dns="[]" Jul 23 22:22:52.642586 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575170 2575 flags.go:64] FLAG: --cluster-domain="" Jul 23 22:22:52.642586 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575173 2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 23 22:22:52.642586 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575176 2575 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 23 22:22:52.642586 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575179 2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 23 22:22:52.642586 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575184 2575 flags.go:64] FLAG: --container-log-max-files="5" Jul 23 22:22:52.642586 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575187 2575 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 23 22:22:52.642586 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575190 2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 23 22:22:52.642586 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575193 2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 23 22:22:52.642586 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575196 2575 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 23 22:22:52.642586 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575199 2575 flags.go:64] FLAG: --contention-profiling="false" Jul 23 22:22:52.642586 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575202 2575 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 23 22:22:52.642586 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575205 2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 23 22:22:52.642586 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575208 2575 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 23 22:22:52.643594 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575210 2575 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 23 22:22:52.643594 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575215 2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 23 22:22:52.643594 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575218 2575 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 23 22:22:52.643594 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575221 2575 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 23 22:22:52.643594 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575223 2575 flags.go:64] FLAG: --enable-load-reader="false" Jul 23 22:22:52.643594 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575226 2575 flags.go:64] FLAG: --enable-server="true" Jul 23 22:22:52.643594 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575229 2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 23 22:22:52.643594 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575233 2575 flags.go:64] FLAG: --event-burst="100" Jul 23 22:22:52.643594 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575236 2575 flags.go:64] FLAG: --event-qps="50" Jul 23 22:22:52.643594 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575239 2575 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 23 22:22:52.643594 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575242 2575 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 23 22:22:52.643594 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575244 2575 flags.go:64] FLAG: --eviction-hard="" Jul 23 22:22:52.643594 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575248 2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 23 22:22:52.643594 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575251 2575 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 23 22:22:52.643594 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575253 2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 23 22:22:52.643594 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575256 2575 flags.go:64] FLAG: --eviction-soft="" Jul 23 22:22:52.643594 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575259 2575 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 23 22:22:52.643594 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575262 2575 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 23 22:22:52.643594 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575264 2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 23 22:22:52.643594 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575267 2575 flags.go:64] FLAG: --experimental-mounter-path="" Jul 23 22:22:52.643594 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575270 2575 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 23 22:22:52.643594 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575273 2575 flags.go:64] FLAG: --fail-swap-on="true" Jul 23 22:22:52.643594 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575276 2575 flags.go:64] FLAG: --feature-gates="" Jul 23 22:22:52.643594 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575281 2575 flags.go:64] FLAG: --file-check-frequency="20s" Jul 23 22:22:52.643594 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575283 2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 23 22:22:52.644574 ip-10-0-134-206 systemd[1]: Started Kubernetes Kubelet. Jul 23 22:22:52.644974 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575286 2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 23 22:22:52.644974 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575289 2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 23 22:22:52.644974 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575292 2575 flags.go:64] FLAG: --healthz-port="10248" Jul 23 22:22:52.644974 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575295 2575 flags.go:64] FLAG: --help="false" Jul 23 22:22:52.644974 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575298 2575 flags.go:64] FLAG: --hostname-override="ip-10-0-134-206.ec2.internal" Jul 23 22:22:52.644974 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575301 2575 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 23 22:22:52.644974 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575303 2575 flags.go:64] FLAG: --http-check-frequency="20s" Jul 23 22:22:52.644974 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575307 2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 23 22:22:52.644974 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575311 2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 23 22:22:52.644974 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575314 2575 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 23 22:22:52.644974 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575317 2575 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 23 22:22:52.644974 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575320 2575 flags.go:64] FLAG: --image-service-endpoint="" Jul 23 22:22:52.644974 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575323 2575 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 23 22:22:52.644974 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575325 2575 flags.go:64] FLAG: --kube-api-burst="100" Jul 23 22:22:52.644974 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575329 2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 23 22:22:52.644974 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575332 2575 flags.go:64] FLAG: --kube-api-qps="50" Jul 23 22:22:52.644974 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575334 2575 flags.go:64] FLAG: --kube-reserved="" Jul 23 22:22:52.644974 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575337 2575 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 23 22:22:52.644974 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575340 2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 23 22:22:52.644974 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575343 2575 flags.go:64] FLAG: --kubelet-cgroups="" Jul 23 22:22:52.644974 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575346 2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 23 22:22:52.644974 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575348 2575 flags.go:64] FLAG: --lock-file="" Jul 23 22:22:52.644974 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575351 2575 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 23 22:22:52.644974 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575354 2575 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 23 22:22:52.646689 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575356 2575 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 23 22:22:52.646689 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575361 2575 flags.go:64] FLAG: --log-json-split-stream="false" Jul 23 22:22:52.646689 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575364 2575 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 23 22:22:52.646689 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575367 2575 flags.go:64] FLAG: --log-text-split-stream="false" Jul 23 22:22:52.646689 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575369 2575 flags.go:64] FLAG: --logging-format="text" Jul 23 22:22:52.646689 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575372 2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 23 22:22:52.646689 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575377 2575 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 23 22:22:52.646689 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575380 2575 flags.go:64] FLAG: --manifest-url="" Jul 23 22:22:52.646689 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575382 2575 flags.go:64] FLAG: --manifest-url-header="" Jul 23 22:22:52.646689 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575386 2575 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 23 22:22:52.646689 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575389 2575 flags.go:64] FLAG: --max-open-files="1000000" Jul 23 22:22:52.646689 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575393 2575 flags.go:64] FLAG: --max-pods="110" Jul 23 22:22:52.646689 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575395 2575 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 23 22:22:52.646689 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575398 2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 23 22:22:52.646689 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575401 2575 flags.go:64] FLAG: --memory-manager-policy="None" Jul 23 22:22:52.646689 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575404 2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 23 22:22:52.646689 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575409 2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 23 22:22:52.646689 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575412 2575 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 23 22:22:52.646689 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575415 2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 23 22:22:52.646689 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575421 2575 flags.go:64] FLAG: --node-status-max-images="50" Jul 23 22:22:52.646689 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575425 2575 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 23 22:22:52.646689 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575427 2575 flags.go:64] FLAG: --oom-score-adj="-999" Jul 23 22:22:52.646689 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575430 2575 flags.go:64] FLAG: --pod-cidr="" Jul 23 22:22:52.896080 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575434 2575 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 23 22:22:52.896080 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575439 2575 flags.go:64] FLAG: --pod-manifest-path="" Jul 23 22:22:52.896080 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575442 2575 flags.go:64] FLAG: --pod-max-pids="-1" Jul 23 22:22:52.896080 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575445 2575 flags.go:64] FLAG: --pods-per-core="0" Jul 23 22:22:52.896080 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575448 2575 flags.go:64] FLAG: --port="10250" Jul 23 22:22:52.896080 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575451 2575 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 23 22:22:52.896080 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575453 2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0f15ddbf0eb559abf" Jul 23 22:22:52.896080 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575456 2575 flags.go:64] FLAG: --qos-reserved="" Jul 23 22:22:52.896080 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575459 2575 flags.go:64] FLAG: --read-only-port="10255" Jul 23 22:22:52.896080 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575462 2575 flags.go:64] FLAG: --register-node="true" Jul 23 22:22:52.896080 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575465 2575 flags.go:64] FLAG: --register-with-taints="" Jul 23 22:22:52.896080 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575468 2575 flags.go:64] FLAG: --registry-burst="10" Jul 23 22:22:52.896080 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575471 2575 flags.go:64] FLAG: --registry-qps="5" Jul 23 22:22:52.896080 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575473 2575 flags.go:64] FLAG: --reserved-cpus="" Jul 23 22:22:52.896080 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575476 2575 flags.go:64] FLAG: --reserved-memory="" Jul 23 22:22:52.896080 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575481 2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 23 22:22:52.896080 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575484 2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 23 22:22:52.896080 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575487 2575 flags.go:64] FLAG: --rotate-certificates="false" Jul 23 22:22:52.896080 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575489 2575 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 23 22:22:52.896080 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575492 2575 flags.go:64] FLAG: --runonce="false" Jul 23 22:22:52.896080 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575495 2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 23 22:22:52.896080 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575498 2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 23 22:22:52.896080 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575501 2575 flags.go:64] FLAG: --seccomp-default="false" Jul 23 22:22:52.896080 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575503 2575 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 23 22:22:52.896080 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575506 2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 23 22:22:52.899219 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575509 2575 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 23 22:22:52.899219 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575513 2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 23 22:22:52.899219 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575516 2575 flags.go:64] FLAG: --storage-driver-password="root" Jul 23 22:22:52.899219 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575519 2575 flags.go:64] FLAG: --storage-driver-secure="false" Jul 23 22:22:52.899219 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575522 2575 flags.go:64] FLAG: --storage-driver-table="stats" Jul 23 22:22:52.899219 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575525 2575 flags.go:64] FLAG: --storage-driver-user="root" Jul 23 22:22:52.899219 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575527 2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 23 22:22:52.899219 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575530 2575 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 23 22:22:52.899219 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575534 2575 flags.go:64] FLAG: --system-cgroups="" Jul 23 22:22:52.899219 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575536 2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 23 22:22:52.899219 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575541 2575 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 23 22:22:52.899219 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575544 2575 flags.go:64] FLAG: --tls-cert-file="" Jul 23 22:22:52.899219 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575547 2575 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 23 22:22:52.899219 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575551 2575 flags.go:64] FLAG: --tls-min-version="" Jul 23 22:22:52.899219 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575553 2575 flags.go:64] FLAG: --tls-private-key-file="" Jul 23 22:22:52.899219 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575556 2575 flags.go:64] FLAG: --topology-manager-policy="none" Jul 23 22:22:52.899219 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575559 2575 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 23 22:22:52.899219 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575562 2575 flags.go:64] FLAG: --topology-manager-scope="container" Jul 23 22:22:52.899219 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575565 2575 flags.go:64] FLAG: --v="2" Jul 23 22:22:52.899219 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575568 2575 flags.go:64] FLAG: --version="false" Jul 23 22:22:52.899219 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575572 2575 flags.go:64] FLAG: --vmodule="" Jul 23 22:22:52.899219 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575576 2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 23 22:22:52.899219 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.575581 2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 23 22:22:52.899219 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575680 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 22:22:52.899219 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575684 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 22:22:52.900146 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575687 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 22:22:52.900146 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575690 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 22:22:52.900146 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575693 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 22:22:52.900146 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575696 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 22:22:52.900146 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575698 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 22:22:52.900146 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575700 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 22:22:52.900146 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575703 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 22:22:52.900146 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575706 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 22:22:52.900146 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575710 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 22:22:52.900146 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575712 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 22:22:52.900146 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575715 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 22:22:52.900146 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575717 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 22:22:52.900146 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575720 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 22:22:52.900146 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575722 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 22:22:52.900146 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575725 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 22:22:52.900146 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575727 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 22:22:52.900146 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575730 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 22:22:52.900146 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575733 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 22:22:52.900146 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575736 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 22:22:52.900146 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575738 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 22:22:52.900790 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575740 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 22:22:52.900790 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575743 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 22:22:52.900790 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575746 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 22:22:52.900790 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575748 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 22:22:52.900790 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575751 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 22:22:52.900790 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575754 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 22:22:52.900790 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575756 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 22:22:52.900790 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575758 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 22:22:52.900790 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575762 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 22:22:52.900790 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575767 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 22:22:52.900790 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575770 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 22:22:52.900790 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575773 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 22:22:52.900790 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575775 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 23 22:22:52.900790 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575778 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 22:22:52.900790 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575781 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 22:22:52.900790 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575783 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 22:22:52.900790 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575786 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 22:22:52.900790 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575790 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 22:22:52.900790 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575793 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 22:22:52.900790 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575796 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 22:22:52.901497 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575800 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 22:22:52.901497 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575802 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 22:22:52.901497 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575805 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 22:22:52.901497 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575808 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 22:22:52.901497 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575811 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 22:22:52.901497 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575813 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 22:22:52.901497 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575816 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 22:22:52.901497 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575818 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 22:22:52.901497 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575821 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 22:22:52.901497 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575824 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 22:22:52.901497 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575826 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 22:22:52.901497 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575829 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 22:22:52.901497 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575831 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 22:22:52.901497 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575834 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 22:22:52.901497 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575836 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 22:22:52.901497 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575839 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 22:22:52.901497 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575841 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 22:22:52.901497 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575844 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 22:22:52.901497 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575846 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 22:22:52.901497 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575848 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 22:22:52.902210 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575851 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 22:22:52.902210 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575855 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 22:22:52.902210 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575858 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 22:22:52.902210 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575860 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 22:22:52.902210 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575863 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 22:22:52.902210 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575865 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 22:22:52.902210 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575868 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 22:22:52.902210 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575870 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 22:22:52.902210 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575873 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 22:22:52.902210 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575875 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 22:22:52.902210 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575877 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 22:22:52.902210 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575881 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 22:22:52.902210 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575886 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 22:22:52.902210 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575889 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 22:22:52.902210 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575892 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 22:22:52.902210 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575894 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 22:22:52.902210 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575897 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 22:22:52.902210 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575899 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 22:22:52.902210 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575902 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 22:22:52.902875 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575904 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 22:22:52.902875 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575907 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 22:22:52.902875 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575910 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 22:22:52.902875 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575912 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 22:22:52.902875 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575915 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 22:22:52.902875 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575918 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 22:22:52.902875 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575920 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 22:22:52.902875 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575923 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 22:22:52.902875 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575925 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 22:22:52.902875 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575928 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 22:22:52.902875 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575930 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 22:22:52.902875 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575933 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 22:22:52.902875 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575935 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 22:22:52.902875 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575938 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 22:22:52.902875 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575941 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 22:22:52.902875 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575944 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 22:22:52.902875 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575946 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 22:22:52.902875 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.575949 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 22:22:52.903420 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.576504 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 23 22:22:52.903420 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.582771 2575 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 23 22:22:52.903420 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.582787 2575 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 23 22:22:52.903420 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.583714 2575 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 23 22:22:52.903420 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.583722 2575 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 23 22:22:52.903420 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.583788 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 22:22:52.903420 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.583793 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 22:22:52.903420 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.583796 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 22:22:52.903420 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.583799 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 22:22:52.903420 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.583802 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 22:22:52.903420 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.583805 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 22:22:52.903420 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.583808 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 22:22:52.903420 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.583811 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 22:22:52.903420 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.583814 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 22:22:52.903420 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.583817 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 22:22:52.904072 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.583819 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 22:22:52.904072 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.583822 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 22:22:52.904072 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.583824 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 22:22:52.904072 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.583827 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 22:22:52.904072 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.583830 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 22:22:52.904072 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.583833 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 22:22:52.904072 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.583835 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 22:22:52.904072 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.583839 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 22:22:52.904072 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.583843 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 22:22:52.904072 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.583846 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 23 22:22:52.904072 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.583849 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 22:22:52.904072 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.583852 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 22:22:52.904072 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.583854 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 22:22:52.904072 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.583857 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 22:22:52.904072 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.583859 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 22:22:52.904072 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.583861 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 22:22:52.904072 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.583864 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 22:22:52.904072 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.583866 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 22:22:52.904072 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.583868 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 22:22:52.904072 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.583879 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 22:22:52.904764 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.583882 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 22:22:52.904764 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.583885 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 22:22:52.904764 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.583887 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 22:22:52.904764 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.583890 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 22:22:52.904764 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.583892 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 22:22:52.904764 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.583894 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 22:22:52.904764 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.583897 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 22:22:52.904764 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.583899 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 22:22:52.904764 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.583902 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 22:22:52.904764 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.583904 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 22:22:52.904764 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.583907 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 22:22:52.904764 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.583909 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 22:22:52.904764 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.583912 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 22:22:52.904764 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.583914 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 22:22:52.904764 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.583917 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 22:22:52.904764 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.583919 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 22:22:52.904764 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.583922 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 22:22:52.904764 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.583925 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 22:22:52.904764 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.583927 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 22:22:52.904764 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.583930 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 22:22:52.905391 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.583932 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 22:22:52.905391 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.583936 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 22:22:52.905391 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.583939 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 22:22:52.905391 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.583942 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 22:22:52.905391 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.583944 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 22:22:52.905391 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.583947 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 22:22:52.905391 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.583950 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 22:22:52.905391 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.583953 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 22:22:52.905391 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.583957 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 22:22:52.905391 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.583960 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 22:22:52.905391 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.583962 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 22:22:52.905391 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.583965 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 22:22:52.905391 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.583973 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 22:22:52.905391 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.583976 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 22:22:52.905391 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.583979 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 22:22:52.905391 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.583981 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 22:22:52.905391 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.583983 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 22:22:52.905391 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.583986 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 22:22:52.906108 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.583989 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 22:22:52.906108 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.583991 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 22:22:52.906108 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.583993 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 22:22:52.906108 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.583997 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 22:22:52.906108 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.583999 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 22:22:52.906108 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584002 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 22:22:52.906108 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584005 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 22:22:52.906108 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584007 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 22:22:52.906108 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584009 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 22:22:52.906108 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584012 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 22:22:52.906108 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584031 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 22:22:52.906108 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584035 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 22:22:52.906108 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584038 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 22:22:52.906108 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584040 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 22:22:52.906108 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584042 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 22:22:52.906108 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584045 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 22:22:52.906108 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584048 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 22:22:52.906108 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584050 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 22:22:52.906108 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584073 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 22:22:52.906108 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584075 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 22:22:52.906699 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584078 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 22:22:52.906699 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584080 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 22:22:52.906699 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584083 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 22:22:52.906699 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584085 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 22:22:52.906699 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584090 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 22:22:52.906699 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584092 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 22:22:52.906699 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584095 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 22:22:52.906699 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584104 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 22:22:52.906699 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584107 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 22:22:52.906699 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584109 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 22:22:52.906699 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584112 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 22:22:52.906699 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.584117 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 23 22:22:52.906699 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584262 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 22:22:52.906699 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584270 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 22:22:52.906699 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584274 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 22:22:52.907149 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584277 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 22:22:52.907149 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584280 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 22:22:52.907149 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584283 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 22:22:52.907149 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584286 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 22:22:52.907149 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584289 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 22:22:52.907149 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584292 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 22:22:52.907149 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584295 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 22:22:52.907149 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584298 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 22:22:52.907149 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584300 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 22:22:52.907149 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584303 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 22:22:52.907149 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584305 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 22:22:52.907149 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584308 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 22:22:52.907149 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584311 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 22:22:52.907149 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584313 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 22:22:52.907149 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584316 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 22:22:52.907149 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584318 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 22:22:52.907149 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584321 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 22:22:52.907149 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584324 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 22:22:52.907149 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584327 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 22:22:52.907149 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584329 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 22:22:52.907697 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584332 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 22:22:52.907697 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584336 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 22:22:52.907697 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584338 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 22:22:52.907697 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584341 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 22:22:52.907697 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584344 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 22:22:52.907697 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584353 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 22:22:52.907697 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584356 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 22:22:52.907697 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584358 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 22:22:52.907697 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584361 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 22:22:52.907697 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584363 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 22:22:52.907697 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584367 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 22:22:52.907697 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584370 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 22:22:52.907697 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584372 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 22:22:52.907697 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584375 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 22:22:52.907697 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584377 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 23 22:22:52.907697 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584380 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 22:22:52.907697 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584382 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 22:22:52.907697 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584385 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 22:22:52.907697 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584388 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 22:22:52.908245 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584390 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 22:22:52.908245 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584393 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 22:22:52.908245 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584395 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 22:22:52.908245 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584398 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 22:22:52.908245 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584400 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 22:22:52.908245 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584403 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 22:22:52.908245 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584405 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 22:22:52.908245 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584408 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 22:22:52.908245 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584410 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 22:22:52.908245 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584413 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 22:22:52.908245 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584415 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 22:22:52.908245 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584418 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 22:22:52.908245 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584420 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 22:22:52.908245 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584423 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 22:22:52.908245 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584427 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 22:22:52.908245 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584430 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 22:22:52.908245 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584432 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 22:22:52.908245 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584436 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 22:22:52.908245 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584438 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 22:22:52.908851 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584449 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 22:22:52.908851 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584451 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 22:22:52.908851 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584454 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 22:22:52.908851 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584456 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 22:22:52.908851 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584459 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 22:22:52.908851 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584461 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 22:22:52.908851 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584464 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 22:22:52.908851 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584466 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 22:22:52.908851 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584469 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 22:22:52.908851 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584471 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 22:22:52.908851 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584474 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 22:22:52.908851 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584476 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 22:22:52.908851 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584479 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 22:22:52.908851 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584481 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 22:22:52.908851 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584483 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 22:22:52.908851 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584486 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 22:22:52.908851 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584488 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 22:22:52.908851 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584491 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 22:22:52.908851 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584494 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 22:22:52.908851 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584496 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 22:22:53.148786 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584499 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 22:22:53.148786 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584501 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 22:22:53.148786 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584504 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 22:22:53.148786 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584506 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 22:22:53.148786 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584508 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 22:22:53.148786 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584511 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 22:22:53.148786 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584514 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 22:22:53.148786 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584517 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 22:22:53.148786 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584520 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 22:22:53.148786 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584522 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 22:22:53.148786 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584528 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 22:22:53.148786 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584530 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 22:22:53.148786 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584534 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 22:22:53.148786 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584543 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 22:22:53.148786 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584546 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 22:22:53.148786 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584549 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 22:22:53.148786 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584552 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 22:22:53.148786 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:52.584554 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 22:22:53.149824 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.584559 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 23 22:22:53.149824 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.584674 2575 server.go:962] "Client rotation is on, will bootstrap in background" Jul 23 22:22:53.149824 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.586711 2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 23 22:22:53.149824 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.588298 2575 server.go:1019] "Starting client certificate rotation" Jul 23 22:22:53.149824 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.588398 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 23 22:22:53.149824 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.588436 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 23 22:22:53.149824 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.593904 2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 23 22:22:53.149824 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.598043 2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 23 22:22:53.149824 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.609618 2575 log.go:25] "Validated CRI v1 runtime API" Jul 23 22:22:53.149824 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.611515 2575 log.go:25] "Validated CRI v1 image API" Jul 23 22:22:53.149824 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.612427 2575 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 23 22:22:53.149824 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.617894 2575 fs.go:135] Filesystem UUIDs: map[2c0528e8-3b3a-415a-a317-999536cc58f9:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 991c709c-d852-4ee8-aa75-7b320705326f:/dev/nvme0n1p3] Jul 23 22:22:53.150249 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.617914 2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 23 22:22:53.150341 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.623594 2575 manager.go:216] Machine: {Timestamp:2026-07-23 22:22:52.622305702 +0000 UTC m=+0.342302953 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3163923 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25299eb91229b14ee3488846ca94d4 SystemUUID:ec25299e-b912-29b1-4ee3-488846ca94d4 BootID:9f9becd2-59f0-4dae-a213-11fb18941c08 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:bc:1f:5d:ed:77 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:bc:1f:5d:ed:77 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:16:c2:aa:01:9d:36 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 23 22:22:53.150341 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.623683 2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 23 22:22:53.150341 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.623747 2575 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 23 22:22:53.150341 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.626938 2575 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 23 22:22:53.150341 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.626976 2575 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-206.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 23 22:22:53.150341 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.627707 2575 topology_manager.go:138] "Creating topology manager with none policy" Jul 23 22:22:53.150341 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.627720 2575 container_manager_linux.go:309] "Creating device plugin manager" Jul 23 22:22:53.150341 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.627729 2575 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 23 22:22:53.150806 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.628287 2575 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 23 22:22:53.150806 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.629438 2575 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 23 22:22:53.150806 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.629739 2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 23 22:22:53.150806 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.632928 2575 state_mem.go:36] "Initialized new in-memory state store" Jul 23 22:22:53.150806 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.633061 2575 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 23 22:22:53.150806 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.633087 2575 kubelet.go:486] "Attempting to sync node with API server" Jul 23 22:22:53.150806 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.633097 2575 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 23 22:22:53.150806 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.633110 2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 23 22:22:53.150806 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.633118 2575 kubelet.go:398] "Adding apiserver pod source" Jul 23 22:22:53.150806 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.633126 2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 23 22:22:53.150806 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.633449 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 23 22:22:53.150806 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.633474 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 23 22:22:53.150806 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.636305 2575 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 23 22:22:53.150806 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.637728 2575 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 23 22:22:53.150806 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.637754 2575 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 23 22:22:53.150806 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.638281 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 23 22:22:53.150806 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.638293 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 23 22:22:53.150806 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.638298 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 23 22:22:53.150806 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.638303 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 23 22:22:53.150806 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.638311 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 23 22:22:53.150806 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.638316 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 23 22:22:53.150806 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.638660 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 23 22:22:53.150806 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.638666 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 23 22:22:53.150806 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.638673 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 23 22:22:53.150806 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.638678 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 23 22:22:53.150806 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.638686 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 23 22:22:53.150806 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.638693 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 23 22:22:53.150806 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.639366 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 23 22:22:53.150806 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.639373 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 23 22:22:53.150806 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.643896 2575 server.go:1268] "Started kubelet" Jul 23 22:22:53.150806 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.644627 2575 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 23 22:22:53.150806 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.644692 2575 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 23 22:22:53.150806 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.645083 2575 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 23 22:22:53.150806 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.646011 2575 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 23 22:22:53.150806 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.646839 2575 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-206.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 23 22:22:53.150806 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:22:52.646863 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-206.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 23 22:22:53.150806 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:22:52.646918 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 23 22:22:53.150806 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.647877 2575 server.go:310] "Adding debug handlers to kubelet server" Jul 23 22:22:53.150806 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.652198 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fh49c" Jul 23 22:22:53.151822 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:22:52.652519 2575 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 23 22:22:53.151822 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:22:52.651827 2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-206.ec2.internal.18c50b68ef700791 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-206.ec2.internal,UID:ip-10-0-134-206.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-206.ec2.internal,},FirstTimestamp:2026-07-23 22:22:52.643870609 +0000 UTC m=+0.363867861,LastTimestamp:2026-07-23 22:22:52.643870609 +0000 UTC m=+0.363867861,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-206.ec2.internal,}" Jul 23 22:22:53.151822 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.653278 2575 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 23 22:22:53.151822 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.653297 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 23 22:22:53.151822 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:22:52.653348 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-206.ec2.internal\" not found" Jul 23 22:22:53.151822 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.654206 2575 factory.go:55] Registering systemd factory Jul 23 22:22:53.151822 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.654244 2575 factory.go:223] Registration of the systemd container factory successfully Jul 23 22:22:53.151822 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.654323 2575 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 23 22:22:53.151822 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.654325 2575 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 23 22:22:53.151822 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.654350 2575 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 23 22:22:53.151822 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.654433 2575 reconstruct.go:97] "Volume reconstruction finished" Jul 23 22:22:53.151822 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.654441 2575 reconciler.go:29] "Reconciler: start to sync state" Jul 23 22:22:53.151822 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.654446 2575 factory.go:153] Registering CRI-O factory Jul 23 22:22:53.151822 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.654460 2575 factory.go:223] Registration of the crio container factory successfully Jul 23 22:22:53.151822 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.654505 2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 23 22:22:53.151822 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.654527 2575 factory.go:103] Registering Raw factory Jul 23 22:22:53.151822 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.654539 2575 manager.go:1196] Started watching for new ooms in manager Jul 23 22:22:53.151822 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.654929 2575 manager.go:349] Starting recovery of all containers Jul 23 22:22:53.151822 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.660259 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fh49c" Jul 23 22:22:53.151822 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.664744 2575 manager.go:354] Recovery completed Jul 23 22:22:53.151822 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.669468 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 22:22:53.151822 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.670286 2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 22:22:53.151822 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.671264 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-206.ec2.internal" event="NodeHasSufficientMemory" Jul 23 22:22:53.151822 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.671293 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-206.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 22:22:53.151822 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.671308 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-206.ec2.internal" event="NodeHasSufficientPID" Jul 23 22:22:53.151822 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.671755 2575 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 23 22:22:53.151822 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.671763 2575 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 23 22:22:53.151822 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.671768 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 22:22:53.151822 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.671776 2575 state_mem.go:36] "Initialized new in-memory state store" Jul 23 22:22:53.151822 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.672490 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-206.ec2.internal" event="NodeHasSufficientMemory" Jul 23 22:22:53.151822 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.672515 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-206.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 22:22:53.151822 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.672530 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-206.ec2.internal" event="NodeHasSufficientPID" Jul 23 22:22:53.151822 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.673035 2575 policy_none.go:49] "None policy: Start" Jul 23 22:22:53.151822 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.673052 2575 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 23 22:22:53.151822 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.673062 2575 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 23 22:22:53.152749 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:22:52.673382 2575 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-134-206.ec2.internal\" not found" node="ip-10-0-134-206.ec2.internal" Jul 23 22:22:53.152749 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.673878 2575 policy_none.go:47] "Start" Jul 23 22:22:53.152749 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.712581 2575 manager.go:337] "Starting Device Plugin manager" Jul 23 22:22:53.152749 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:22:52.712605 2575 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 23 22:22:53.152749 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.712614 2575 server.go:87] "Starting device plugin registration server" Jul 23 22:22:53.152749 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.712808 2575 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 23 22:22:53.152749 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.712820 2575 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 23 22:22:53.152749 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.712904 2575 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 23 22:22:53.152749 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.713102 2575 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 23 22:22:53.152749 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.713112 2575 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 23 22:22:53.152749 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:22:52.713426 2575 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 23 22:22:53.152749 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:22:52.713473 2575 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-206.ec2.internal\" not found" Jul 23 22:22:53.152749 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.799944 2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 23 22:22:53.152749 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.801009 2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 23 22:22:53.152749 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.801075 2575 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 23 22:22:53.152749 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.801096 2575 kubelet.go:2448] "Starting kubelet main sync loop" Jul 23 22:22:53.152749 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:22:52.801131 2575 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 23 22:22:53.152749 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.803522 2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 22:22:53.152749 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.813734 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 22:22:53.152749 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.814416 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-206.ec2.internal" event="NodeHasSufficientMemory" Jul 23 22:22:53.152749 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.814440 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-206.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 22:22:53.152749 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.814449 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-206.ec2.internal" event="NodeHasSufficientPID" Jul 23 22:22:53.152749 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.814465 2575 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-206.ec2.internal" Jul 23 22:22:53.152749 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.822624 2575 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-206.ec2.internal" Jul 23 22:22:53.152749 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:22:52.822638 2575 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-206.ec2.internal\": node \"ip-10-0-134-206.ec2.internal\" not found" Jul 23 22:22:53.152749 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:22:52.837406 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-206.ec2.internal\" not found" Jul 23 22:22:53.152749 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.901704 2575 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-206.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-206.ec2.internal"] Jul 23 22:22:53.152749 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.901749 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 22:22:53.152749 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.902484 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-206.ec2.internal" event="NodeHasSufficientMemory" Jul 23 22:22:53.152749 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.902506 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-206.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 22:22:53.152749 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.902516 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-206.ec2.internal" event="NodeHasSufficientPID" Jul 23 22:22:53.152749 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.903553 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 22:22:53.152749 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.903663 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-206.ec2.internal" Jul 23 22:22:53.152749 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.903697 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 22:22:53.152749 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.904233 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-206.ec2.internal" event="NodeHasSufficientMemory" Jul 23 22:22:53.152749 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.904257 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-206.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 22:22:53.152749 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.904266 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-206.ec2.internal" event="NodeHasSufficientPID" Jul 23 22:22:53.153620 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.904236 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-206.ec2.internal" event="NodeHasSufficientMemory" Jul 23 22:22:53.153620 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.904332 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-206.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 22:22:53.153620 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.904344 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-206.ec2.internal" event="NodeHasSufficientPID" Jul 23 22:22:53.153620 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.905457 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-206.ec2.internal" Jul 23 22:22:53.153620 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.905475 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 22:22:53.153620 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.906075 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-206.ec2.internal" event="NodeHasSufficientMemory" Jul 23 22:22:53.153620 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.906097 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-206.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 22:22:53.153620 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.906110 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-206.ec2.internal" event="NodeHasSufficientPID" Jul 23 22:22:53.153620 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:22:52.937976 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-206.ec2.internal\" not found" Jul 23 22:22:53.153620 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:22:52.939404 2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-206.ec2.internal\" not found" node="ip-10-0-134-206.ec2.internal" Jul 23 22:22:53.153620 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:22:52.943342 2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-206.ec2.internal\" not found" node="ip-10-0-134-206.ec2.internal" Jul 23 22:22:53.153620 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.956042 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c327b22ac949a2a8daf1ee2904cbe0b1-config\") pod \"kube-apiserver-proxy-ip-10-0-134-206.ec2.internal\" (UID: \"c327b22ac949a2a8daf1ee2904cbe0b1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-206.ec2.internal" Jul 23 22:22:53.153620 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.956087 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0baba1e243f7aa3ffdfefa29d6fc657e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-206.ec2.internal\" (UID: \"0baba1e243f7aa3ffdfefa29d6fc657e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-206.ec2.internal" Jul 23 22:22:53.153620 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:52.956103 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0baba1e243f7aa3ffdfefa29d6fc657e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-206.ec2.internal\" (UID: \"0baba1e243f7aa3ffdfefa29d6fc657e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-206.ec2.internal" Jul 23 22:22:53.153620 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:22:53.038191 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-206.ec2.internal\" not found" Jul 23 22:22:53.153620 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.056518 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0baba1e243f7aa3ffdfefa29d6fc657e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-206.ec2.internal\" (UID: \"0baba1e243f7aa3ffdfefa29d6fc657e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-206.ec2.internal" Jul 23 22:22:53.153620 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.056541 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0baba1e243f7aa3ffdfefa29d6fc657e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-206.ec2.internal\" (UID: \"0baba1e243f7aa3ffdfefa29d6fc657e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-206.ec2.internal" Jul 23 22:22:53.153620 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.056557 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c327b22ac949a2a8daf1ee2904cbe0b1-config\") pod \"kube-apiserver-proxy-ip-10-0-134-206.ec2.internal\" (UID: \"c327b22ac949a2a8daf1ee2904cbe0b1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-206.ec2.internal" Jul 23 22:22:53.153620 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.056589 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c327b22ac949a2a8daf1ee2904cbe0b1-config\") pod \"kube-apiserver-proxy-ip-10-0-134-206.ec2.internal\" (UID: \"c327b22ac949a2a8daf1ee2904cbe0b1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-206.ec2.internal" Jul 23 22:22:53.153620 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.056625 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0baba1e243f7aa3ffdfefa29d6fc657e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-206.ec2.internal\" (UID: \"0baba1e243f7aa3ffdfefa29d6fc657e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-206.ec2.internal" Jul 23 22:22:53.154192 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.056647 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0baba1e243f7aa3ffdfefa29d6fc657e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-206.ec2.internal\" (UID: \"0baba1e243f7aa3ffdfefa29d6fc657e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-206.ec2.internal" Jul 23 22:22:53.154192 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:22:53.138826 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-206.ec2.internal\" not found" Jul 23 22:22:53.363860 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:22:53.239182 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-206.ec2.internal\" not found" Jul 23 22:22:53.363860 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.241310 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-206.ec2.internal" Jul 23 22:22:53.363860 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.248361 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-206.ec2.internal" Jul 23 22:22:53.363860 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:22:53.339907 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-206.ec2.internal\" not found" Jul 23 22:22:53.538725 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:22:53.440341 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-206.ec2.internal\" not found" Jul 23 22:22:53.541052 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:22:53.540686 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-206.ec2.internal\" not found" Jul 23 22:22:53.710448 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.587111 2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 23 22:22:53.710448 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.587209 2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 23 22:22:53.710448 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.587241 2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 23 22:22:53.710448 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.597889 2575 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 22:22:53.710448 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.633416 2575 apiserver.go:52] "Watching apiserver" Jul 23 22:22:53.710448 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.641556 2575 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 23 22:22:53.710448 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.641892 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-6t59s","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dvvl7","openshift-dns/node-resolver-qwb6v","openshift-multus/multus-additional-cni-plugins-2sdbj","openshift-multus/network-metrics-daemon-fd6hg","openshift-network-diagnostics/network-check-target-ks6hk","openshift-ovn-kubernetes/ovnkube-node-hrvdq","openshift-cluster-node-tuning-operator/tuned-g48n5","openshift-image-registry/node-ca-9vqwp","openshift-multus/multus-q66nz","openshift-network-operator/iptables-alerter-pkrss","kube-system/global-pull-secret-syncer-pl657"] Jul 23 22:22:53.710448 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.643057 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6t59s" Jul 23 22:22:53.710448 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.644489 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dvvl7" Jul 23 22:22:53.710448 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.645345 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 23 22:22:53.710448 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.645359 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qwb6v" Jul 23 22:22:53.710448 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.645346 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-sbtvf\"" Jul 23 22:22:53.710448 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.645951 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 23 22:22:53.710448 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.646389 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 23 22:22:53.710448 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.646759 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2sdbj" Jul 23 22:22:53.710448 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.647203 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 23 22:22:53.710448 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.647457 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-49drd\"" Jul 23 22:22:53.710448 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.647625 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-pqsdz\"" Jul 23 22:22:53.710448 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.647752 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 23 22:22:53.710448 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.647776 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fd6hg" Jul 23 22:22:53.710448 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:22:53.647843 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fd6hg" podUID="fc3410ae-ba34-41dc-b992-c51a7bd26fd4" Jul 23 22:22:53.710448 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.648121 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 23 22:22:53.710448 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.648158 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 23 22:22:53.710448 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.648841 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 23 22:22:53.710448 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.648880 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 23 22:22:53.710448 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.649286 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 23 22:22:53.710448 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.649382 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 23 22:22:53.711847 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.649395 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-xdkcq\"" Jul 23 22:22:53.711847 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.649581 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ks6hk" Jul 23 22:22:53.711847 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:22:53.649624 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ks6hk" podUID="2d81f7cf-acbc-4389-b9fb-e621c3c060d4" Jul 23 22:22:53.711847 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.649630 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 23 22:22:53.711847 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.650725 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hrvdq" Jul 23 22:22:53.711847 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.651804 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-g48n5" Jul 23 22:22:53.711847 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.652481 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 23 22:22:53.711847 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.652776 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 23 22:22:53.711847 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.652783 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-tkkw9\"" Jul 23 22:22:53.711847 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.652789 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 23 22:22:53.711847 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.652863 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9vqwp" Jul 23 22:22:53.711847 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.652888 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 23 22:22:53.711847 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.652897 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 23 22:22:53.711847 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.653228 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 23 22:22:53.711847 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.653352 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 23 22:22:53.711847 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.653472 2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-206.ec2.internal" Jul 23 22:22:53.711847 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.653505 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 23 22:22:53.711847 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.653702 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 23 22:22:53.711847 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.653841 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-t47xv\"" Jul 23 22:22:53.711847 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.654086 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-q66nz" Jul 23 22:22:53.711847 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.654867 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 23 22:22:53.711847 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.654974 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 23 22:22:53.711847 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.655010 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-9j4g7\"" Jul 23 22:22:53.711847 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.654976 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 23 22:22:53.711847 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.655153 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pkrss" Jul 23 22:22:53.711847 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.655922 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-g4xrb\"" Jul 23 22:22:53.711847 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.655971 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 23 22:22:53.711847 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.656370 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pl657" Jul 23 22:22:53.711847 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:22:53.656407 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pl657" podUID="81890460-aa07-4749-aadd-909c876b9244" Jul 23 22:22:53.712884 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.657103 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 23 22:22:53.712884 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.657123 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-d6tlr\"" Jul 23 22:22:53.712884 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.657184 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 23 22:22:53.712884 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.657205 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 23 22:22:53.712884 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.659267 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/13d4e65e-9e85-4531-a139-0224fac37ac3-host-var-lib-cni-bin\") pod \"multus-q66nz\" (UID: \"13d4e65e-9e85-4531-a139-0224fac37ac3\") " pod="openshift-multus/multus-q66nz" Jul 23 22:22:53.712884 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.659289 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6e8b3555-1c33-4b27-8431-caf4c5b1a347-socket-dir\") pod \"aws-ebs-csi-driver-node-dvvl7\" (UID: \"6e8b3555-1c33-4b27-8431-caf4c5b1a347\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dvvl7" Jul 23 22:22:53.712884 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.659309 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0dbcc8cc-adc8-472c-976c-f30472ad20b2-os-release\") pod \"multus-additional-cni-plugins-2sdbj\" (UID: \"0dbcc8cc-adc8-472c-976c-f30472ad20b2\") " pod="openshift-multus/multus-additional-cni-plugins-2sdbj" Jul 23 22:22:53.712884 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.659325 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dc2abf53-dbe9-411d-9da0-d36d8445fa59-tmp\") pod \"tuned-g48n5\" (UID: \"dc2abf53-dbe9-411d-9da0-d36d8445fa59\") " pod="openshift-cluster-node-tuning-operator/tuned-g48n5" Jul 23 22:22:53.712884 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.659342 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/13d4e65e-9e85-4531-a139-0224fac37ac3-hostroot\") pod \"multus-q66nz\" (UID: \"13d4e65e-9e85-4531-a139-0224fac37ac3\") " pod="openshift-multus/multus-q66nz" Jul 23 22:22:53.712884 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.659358 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6e8b3555-1c33-4b27-8431-caf4c5b1a347-sys-fs\") pod \"aws-ebs-csi-driver-node-dvvl7\" (UID: \"6e8b3555-1c33-4b27-8431-caf4c5b1a347\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dvvl7" Jul 23 22:22:53.712884 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.659375 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0dbcc8cc-adc8-472c-976c-f30472ad20b2-system-cni-dir\") pod \"multus-additional-cni-plugins-2sdbj\" (UID: \"0dbcc8cc-adc8-472c-976c-f30472ad20b2\") " pod="openshift-multus/multus-additional-cni-plugins-2sdbj" Jul 23 22:22:53.712884 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.659392 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1df4f160-29b0-42fb-a1f5-46b469eec23b-log-socket\") pod \"ovnkube-node-hrvdq\" (UID: \"1df4f160-29b0-42fb-a1f5-46b469eec23b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrvdq" Jul 23 22:22:53.712884 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.659408 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1df4f160-29b0-42fb-a1f5-46b469eec23b-host-cni-bin\") pod \"ovnkube-node-hrvdq\" (UID: \"1df4f160-29b0-42fb-a1f5-46b469eec23b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrvdq" Jul 23 22:22:53.712884 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.659423 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1df4f160-29b0-42fb-a1f5-46b469eec23b-run-ovn\") pod \"ovnkube-node-hrvdq\" (UID: \"1df4f160-29b0-42fb-a1f5-46b469eec23b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrvdq" Jul 23 22:22:53.712884 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.660688 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pl5x4\" (UniqueName: \"kubernetes.io/projected/29b80f76-486c-4fbb-a2ec-c66f223803ba-kube-api-access-pl5x4\") pod \"node-ca-9vqwp\" (UID: \"29b80f76-486c-4fbb-a2ec-c66f223803ba\") " pod="openshift-image-registry/node-ca-9vqwp" Jul 23 22:22:53.712884 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.660706 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1df4f160-29b0-42fb-a1f5-46b469eec23b-systemd-units\") pod \"ovnkube-node-hrvdq\" (UID: \"1df4f160-29b0-42fb-a1f5-46b469eec23b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrvdq" Jul 23 22:22:53.713477 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.660723 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1df4f160-29b0-42fb-a1f5-46b469eec23b-ovn-node-metrics-cert\") pod \"ovnkube-node-hrvdq\" (UID: \"1df4f160-29b0-42fb-a1f5-46b469eec23b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrvdq" Jul 23 22:22:53.713477 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.660739 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1df4f160-29b0-42fb-a1f5-46b469eec23b-ovnkube-script-lib\") pod \"ovnkube-node-hrvdq\" (UID: \"1df4f160-29b0-42fb-a1f5-46b469eec23b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrvdq" Jul 23 22:22:53.713477 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.660756 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dc2abf53-dbe9-411d-9da0-d36d8445fa59-etc-kubernetes\") pod \"tuned-g48n5\" (UID: \"dc2abf53-dbe9-411d-9da0-d36d8445fa59\") " pod="openshift-cluster-node-tuning-operator/tuned-g48n5" Jul 23 22:22:53.713477 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.660776 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e3b1b5a6-36fa-44e7-9a9c-a2e045119f90-hosts-file\") pod \"node-resolver-qwb6v\" (UID: \"e3b1b5a6-36fa-44e7-9a9c-a2e045119f90\") " pod="openshift-dns/node-resolver-qwb6v" Jul 23 22:22:53.713477 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.660792 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/13d4e65e-9e85-4531-a139-0224fac37ac3-system-cni-dir\") pod \"multus-q66nz\" (UID: \"13d4e65e-9e85-4531-a139-0224fac37ac3\") " pod="openshift-multus/multus-q66nz" Jul 23 22:22:53.713477 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.660809 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/13d4e65e-9e85-4531-a139-0224fac37ac3-host-var-lib-cni-multus\") pod \"multus-q66nz\" (UID: \"13d4e65e-9e85-4531-a139-0224fac37ac3\") " pod="openshift-multus/multus-q66nz" Jul 23 22:22:53.713477 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.660826 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/13d4e65e-9e85-4531-a139-0224fac37ac3-host-run-multus-certs\") pod \"multus-q66nz\" (UID: \"13d4e65e-9e85-4531-a139-0224fac37ac3\") " pod="openshift-multus/multus-q66nz" Jul 23 22:22:53.713477 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.660841 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1df4f160-29b0-42fb-a1f5-46b469eec23b-host-run-netns\") pod \"ovnkube-node-hrvdq\" (UID: \"1df4f160-29b0-42fb-a1f5-46b469eec23b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrvdq" Jul 23 22:22:53.713477 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.661075 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/13d4e65e-9e85-4531-a139-0224fac37ac3-multus-daemon-config\") pod \"multus-q66nz\" (UID: \"13d4e65e-9e85-4531-a139-0224fac37ac3\") " pod="openshift-multus/multus-q66nz" Jul 23 22:22:53.713477 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.661107 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6e8b3555-1c33-4b27-8431-caf4c5b1a347-device-dir\") pod \"aws-ebs-csi-driver-node-dvvl7\" (UID: \"6e8b3555-1c33-4b27-8431-caf4c5b1a347\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dvvl7" Jul 23 22:22:53.713477 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.661151 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4h9rg\" (UniqueName: \"kubernetes.io/projected/0dbcc8cc-adc8-472c-976c-f30472ad20b2-kube-api-access-4h9rg\") pod \"multus-additional-cni-plugins-2sdbj\" (UID: \"0dbcc8cc-adc8-472c-976c-f30472ad20b2\") " pod="openshift-multus/multus-additional-cni-plugins-2sdbj" Jul 23 22:22:53.713477 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.661195 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dc2abf53-dbe9-411d-9da0-d36d8445fa59-etc-modprobe-d\") pod \"tuned-g48n5\" (UID: \"dc2abf53-dbe9-411d-9da0-d36d8445fa59\") " pod="openshift-cluster-node-tuning-operator/tuned-g48n5" Jul 23 22:22:53.713477 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.661228 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dc2abf53-dbe9-411d-9da0-d36d8445fa59-var-lib-kubelet\") pod \"tuned-g48n5\" (UID: \"dc2abf53-dbe9-411d-9da0-d36d8445fa59\") " pod="openshift-cluster-node-tuning-operator/tuned-g48n5" Jul 23 22:22:53.713477 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.661247 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/13d4e65e-9e85-4531-a139-0224fac37ac3-multus-socket-dir-parent\") pod \"multus-q66nz\" (UID: \"13d4e65e-9e85-4531-a139-0224fac37ac3\") " pod="openshift-multus/multus-q66nz" Jul 23 22:22:53.714093 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.661278 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0dbcc8cc-adc8-472c-976c-f30472ad20b2-cni-binary-copy\") pod \"multus-additional-cni-plugins-2sdbj\" (UID: \"0dbcc8cc-adc8-472c-976c-f30472ad20b2\") " pod="openshift-multus/multus-additional-cni-plugins-2sdbj" Jul 23 22:22:53.714093 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.661302 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1df4f160-29b0-42fb-a1f5-46b469eec23b-host-slash\") pod \"ovnkube-node-hrvdq\" (UID: \"1df4f160-29b0-42fb-a1f5-46b469eec23b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrvdq" Jul 23 22:22:53.714093 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.661326 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/13d4e65e-9e85-4531-a139-0224fac37ac3-cni-binary-copy\") pod \"multus-q66nz\" (UID: \"13d4e65e-9e85-4531-a139-0224fac37ac3\") " pod="openshift-multus/multus-q66nz" Jul 23 22:22:53.714093 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.661359 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwhn2\" (UniqueName: \"kubernetes.io/projected/2d81f7cf-acbc-4389-b9fb-e621c3c060d4-kube-api-access-hwhn2\") pod \"network-check-target-ks6hk\" (UID: \"2d81f7cf-acbc-4389-b9fb-e621c3c060d4\") " pod="openshift-network-diagnostics/network-check-target-ks6hk" Jul 23 22:22:53.714093 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.661373 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1df4f160-29b0-42fb-a1f5-46b469eec23b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hrvdq\" (UID: \"1df4f160-29b0-42fb-a1f5-46b469eec23b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrvdq" Jul 23 22:22:53.714093 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.661390 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dc2abf53-dbe9-411d-9da0-d36d8445fa59-lib-modules\") pod \"tuned-g48n5\" (UID: \"dc2abf53-dbe9-411d-9da0-d36d8445fa59\") " pod="openshift-cluster-node-tuning-operator/tuned-g48n5" Jul 23 22:22:53.714093 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.661410 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/29b80f76-486c-4fbb-a2ec-c66f223803ba-serviceca\") pod \"node-ca-9vqwp\" (UID: \"29b80f76-486c-4fbb-a2ec-c66f223803ba\") " pod="openshift-image-registry/node-ca-9vqwp" Jul 23 22:22:53.714093 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.661450 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e3b1b5a6-36fa-44e7-9a9c-a2e045119f90-tmp-dir\") pod \"node-resolver-qwb6v\" (UID: \"e3b1b5a6-36fa-44e7-9a9c-a2e045119f90\") " pod="openshift-dns/node-resolver-qwb6v" Jul 23 22:22:53.714093 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.661484 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/13d4e65e-9e85-4531-a139-0224fac37ac3-multus-conf-dir\") pod \"multus-q66nz\" (UID: \"13d4e65e-9e85-4531-a139-0224fac37ac3\") " pod="openshift-multus/multus-q66nz" Jul 23 22:22:53.714093 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.661512 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0dbcc8cc-adc8-472c-976c-f30472ad20b2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2sdbj\" (UID: \"0dbcc8cc-adc8-472c-976c-f30472ad20b2\") " pod="openshift-multus/multus-additional-cni-plugins-2sdbj" Jul 23 22:22:53.714093 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.661533 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8mzf\" (UniqueName: \"kubernetes.io/projected/fc3410ae-ba34-41dc-b992-c51a7bd26fd4-kube-api-access-d8mzf\") pod \"network-metrics-daemon-fd6hg\" (UID: \"fc3410ae-ba34-41dc-b992-c51a7bd26fd4\") " pod="openshift-multus/network-metrics-daemon-fd6hg" Jul 23 22:22:53.714093 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.661553 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1df4f160-29b0-42fb-a1f5-46b469eec23b-var-lib-openvswitch\") pod \"ovnkube-node-hrvdq\" (UID: \"1df4f160-29b0-42fb-a1f5-46b469eec23b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrvdq" Jul 23 22:22:53.714093 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.661566 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1df4f160-29b0-42fb-a1f5-46b469eec23b-ovnkube-config\") pod \"ovnkube-node-hrvdq\" (UID: \"1df4f160-29b0-42fb-a1f5-46b469eec23b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrvdq" Jul 23 22:22:53.714580 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.661587 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktmhk\" (UniqueName: \"kubernetes.io/projected/1df4f160-29b0-42fb-a1f5-46b469eec23b-kube-api-access-ktmhk\") pod \"ovnkube-node-hrvdq\" (UID: \"1df4f160-29b0-42fb-a1f5-46b469eec23b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrvdq" Jul 23 22:22:53.714580 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.661612 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dc2abf53-dbe9-411d-9da0-d36d8445fa59-run\") pod \"tuned-g48n5\" (UID: \"dc2abf53-dbe9-411d-9da0-d36d8445fa59\") " pod="openshift-cluster-node-tuning-operator/tuned-g48n5" Jul 23 22:22:53.714580 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.661628 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/29b80f76-486c-4fbb-a2ec-c66f223803ba-host\") pod \"node-ca-9vqwp\" (UID: \"29b80f76-486c-4fbb-a2ec-c66f223803ba\") " pod="openshift-image-registry/node-ca-9vqwp" Jul 23 22:22:53.714580 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.661641 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13d4e65e-9e85-4531-a139-0224fac37ac3-etc-kubernetes\") pod \"multus-q66nz\" (UID: \"13d4e65e-9e85-4531-a139-0224fac37ac3\") " pod="openshift-multus/multus-q66nz" Jul 23 22:22:53.714580 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.661653 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0dbcc8cc-adc8-472c-976c-f30472ad20b2-cnibin\") pod \"multus-additional-cni-plugins-2sdbj\" (UID: \"0dbcc8cc-adc8-472c-976c-f30472ad20b2\") " pod="openshift-multus/multus-additional-cni-plugins-2sdbj" Jul 23 22:22:53.714580 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.661666 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0dbcc8cc-adc8-472c-976c-f30472ad20b2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2sdbj\" (UID: \"0dbcc8cc-adc8-472c-976c-f30472ad20b2\") " pod="openshift-multus/multus-additional-cni-plugins-2sdbj" Jul 23 22:22:53.714580 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.661700 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1df4f160-29b0-42fb-a1f5-46b469eec23b-node-log\") pod \"ovnkube-node-hrvdq\" (UID: \"1df4f160-29b0-42fb-a1f5-46b469eec23b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrvdq" Jul 23 22:22:53.714580 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.661725 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1df4f160-29b0-42fb-a1f5-46b469eec23b-env-overrides\") pod \"ovnkube-node-hrvdq\" (UID: \"1df4f160-29b0-42fb-a1f5-46b469eec23b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrvdq" Jul 23 22:22:53.714580 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.661739 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dc2abf53-dbe9-411d-9da0-d36d8445fa59-etc-sysctl-conf\") pod \"tuned-g48n5\" (UID: \"dc2abf53-dbe9-411d-9da0-d36d8445fa59\") " pod="openshift-cluster-node-tuning-operator/tuned-g48n5" Jul 23 22:22:53.714580 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.662203 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dc2abf53-dbe9-411d-9da0-d36d8445fa59-host\") pod \"tuned-g48n5\" (UID: \"dc2abf53-dbe9-411d-9da0-d36d8445fa59\") " pod="openshift-cluster-node-tuning-operator/tuned-g48n5" Jul 23 22:22:53.714580 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.662234 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/74793765-85c1-4990-8cb0-892552debf77-konnectivity-ca\") pod \"konnectivity-agent-6t59s\" (UID: \"74793765-85c1-4990-8cb0-892552debf77\") " pod="kube-system/konnectivity-agent-6t59s" Jul 23 22:22:53.714580 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.662246 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/13d4e65e-9e85-4531-a139-0224fac37ac3-cnibin\") pod \"multus-q66nz\" (UID: \"13d4e65e-9e85-4531-a139-0224fac37ac3\") " pod="openshift-multus/multus-q66nz" Jul 23 22:22:53.714580 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.662267 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0dbcc8cc-adc8-472c-976c-f30472ad20b2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2sdbj\" (UID: \"0dbcc8cc-adc8-472c-976c-f30472ad20b2\") " pod="openshift-multus/multus-additional-cni-plugins-2sdbj" Jul 23 22:22:53.714580 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.662285 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dc2abf53-dbe9-411d-9da0-d36d8445fa59-etc-sysctl-d\") pod \"tuned-g48n5\" (UID: \"dc2abf53-dbe9-411d-9da0-d36d8445fa59\") " pod="openshift-cluster-node-tuning-operator/tuned-g48n5" Jul 23 22:22:53.715108 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.662297 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dc2abf53-dbe9-411d-9da0-d36d8445fa59-etc-systemd\") pod \"tuned-g48n5\" (UID: \"dc2abf53-dbe9-411d-9da0-d36d8445fa59\") " pod="openshift-cluster-node-tuning-operator/tuned-g48n5" Jul 23 22:22:53.715108 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.662308 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/13d4e65e-9e85-4531-a139-0224fac37ac3-os-release\") pod \"multus-q66nz\" (UID: \"13d4e65e-9e85-4531-a139-0224fac37ac3\") " pod="openshift-multus/multus-q66nz" Jul 23 22:22:53.715108 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.662319 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/13d4e65e-9e85-4531-a139-0224fac37ac3-host-run-k8s-cni-cncf-io\") pod \"multus-q66nz\" (UID: \"13d4e65e-9e85-4531-a139-0224fac37ac3\") " pod="openshift-multus/multus-q66nz" Jul 23 22:22:53.715108 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.662337 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/13d4e65e-9e85-4531-a139-0224fac37ac3-host-var-lib-kubelet\") pod \"multus-q66nz\" (UID: \"13d4e65e-9e85-4531-a139-0224fac37ac3\") " pod="openshift-multus/multus-q66nz" Jul 23 22:22:53.715108 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.662376 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f9e1354d-23f7-472b-8486-a9eccb352a8e-iptables-alerter-script\") pod \"iptables-alerter-pkrss\" (UID: \"f9e1354d-23f7-472b-8486-a9eccb352a8e\") " pod="openshift-network-operator/iptables-alerter-pkrss" Jul 23 22:22:53.715108 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.662404 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f9e1354d-23f7-472b-8486-a9eccb352a8e-host-slash\") pod \"iptables-alerter-pkrss\" (UID: \"f9e1354d-23f7-472b-8486-a9eccb352a8e\") " pod="openshift-network-operator/iptables-alerter-pkrss" Jul 23 22:22:53.715108 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.662425 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1df4f160-29b0-42fb-a1f5-46b469eec23b-host-kubelet\") pod \"ovnkube-node-hrvdq\" (UID: \"1df4f160-29b0-42fb-a1f5-46b469eec23b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrvdq" Jul 23 22:22:53.715108 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.662443 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1df4f160-29b0-42fb-a1f5-46b469eec23b-host-cni-netd\") pod \"ovnkube-node-hrvdq\" (UID: \"1df4f160-29b0-42fb-a1f5-46b469eec23b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrvdq" Jul 23 22:22:53.715108 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.662476 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2jjv\" (UniqueName: \"kubernetes.io/projected/f9e1354d-23f7-472b-8486-a9eccb352a8e-kube-api-access-t2jjv\") pod \"iptables-alerter-pkrss\" (UID: \"f9e1354d-23f7-472b-8486-a9eccb352a8e\") " pod="openshift-network-operator/iptables-alerter-pkrss" Jul 23 22:22:53.715108 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.662504 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlpzm\" (UniqueName: \"kubernetes.io/projected/6e8b3555-1c33-4b27-8431-caf4c5b1a347-kube-api-access-jlpzm\") pod \"aws-ebs-csi-driver-node-dvvl7\" (UID: \"6e8b3555-1c33-4b27-8431-caf4c5b1a347\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dvvl7" Jul 23 22:22:53.715108 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.662528 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1df4f160-29b0-42fb-a1f5-46b469eec23b-etc-openvswitch\") pod \"ovnkube-node-hrvdq\" (UID: \"1df4f160-29b0-42fb-a1f5-46b469eec23b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrvdq" Jul 23 22:22:53.715108 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.662549 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dc2abf53-dbe9-411d-9da0-d36d8445fa59-sys\") pod \"tuned-g48n5\" (UID: \"dc2abf53-dbe9-411d-9da0-d36d8445fa59\") " pod="openshift-cluster-node-tuning-operator/tuned-g48n5" Jul 23 22:22:53.715108 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.662568 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dc2abf53-dbe9-411d-9da0-d36d8445fa59-etc-tuned\") pod \"tuned-g48n5\" (UID: \"dc2abf53-dbe9-411d-9da0-d36d8445fa59\") " pod="openshift-cluster-node-tuning-operator/tuned-g48n5" Jul 23 22:22:53.715108 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.662587 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6e8b3555-1c33-4b27-8431-caf4c5b1a347-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dvvl7\" (UID: \"6e8b3555-1c33-4b27-8431-caf4c5b1a347\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dvvl7" Jul 23 22:22:53.715519 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.662606 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6e8b3555-1c33-4b27-8431-caf4c5b1a347-etc-selinux\") pod \"aws-ebs-csi-driver-node-dvvl7\" (UID: \"6e8b3555-1c33-4b27-8431-caf4c5b1a347\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dvvl7" Jul 23 22:22:53.715519 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.662622 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1df4f160-29b0-42fb-a1f5-46b469eec23b-run-openvswitch\") pod \"ovnkube-node-hrvdq\" (UID: \"1df4f160-29b0-42fb-a1f5-46b469eec23b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrvdq" Jul 23 22:22:53.715519 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.662641 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dc2abf53-dbe9-411d-9da0-d36d8445fa59-etc-sysconfig\") pod \"tuned-g48n5\" (UID: \"dc2abf53-dbe9-411d-9da0-d36d8445fa59\") " pod="openshift-cluster-node-tuning-operator/tuned-g48n5" Jul 23 22:22:53.715519 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.662665 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65mqs\" (UniqueName: \"kubernetes.io/projected/dc2abf53-dbe9-411d-9da0-d36d8445fa59-kube-api-access-65mqs\") pod \"tuned-g48n5\" (UID: \"dc2abf53-dbe9-411d-9da0-d36d8445fa59\") " pod="openshift-cluster-node-tuning-operator/tuned-g48n5" Jul 23 22:22:53.715519 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.662682 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/74793765-85c1-4990-8cb0-892552debf77-agent-certs\") pod \"konnectivity-agent-6t59s\" (UID: \"74793765-85c1-4990-8cb0-892552debf77\") " pod="kube-system/konnectivity-agent-6t59s" Jul 23 22:22:53.715519 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.662698 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrvg8\" (UniqueName: \"kubernetes.io/projected/e3b1b5a6-36fa-44e7-9a9c-a2e045119f90-kube-api-access-mrvg8\") pod \"node-resolver-qwb6v\" (UID: \"e3b1b5a6-36fa-44e7-9a9c-a2e045119f90\") " pod="openshift-dns/node-resolver-qwb6v" Jul 23 22:22:53.715519 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.662712 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/13d4e65e-9e85-4531-a139-0224fac37ac3-host-run-netns\") pod \"multus-q66nz\" (UID: \"13d4e65e-9e85-4531-a139-0224fac37ac3\") " pod="openshift-multus/multus-q66nz" Jul 23 22:22:53.715519 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.662737 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6e8b3555-1c33-4b27-8431-caf4c5b1a347-registration-dir\") pod \"aws-ebs-csi-driver-node-dvvl7\" (UID: \"6e8b3555-1c33-4b27-8431-caf4c5b1a347\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dvvl7" Jul 23 22:22:53.715519 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.662762 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc3410ae-ba34-41dc-b992-c51a7bd26fd4-metrics-certs\") pod \"network-metrics-daemon-fd6hg\" (UID: \"fc3410ae-ba34-41dc-b992-c51a7bd26fd4\") " pod="openshift-multus/network-metrics-daemon-fd6hg" Jul 23 22:22:53.715519 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.662782 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcmsz\" (UniqueName: \"kubernetes.io/projected/13d4e65e-9e85-4531-a139-0224fac37ac3-kube-api-access-wcmsz\") pod \"multus-q66nz\" (UID: \"13d4e65e-9e85-4531-a139-0224fac37ac3\") " pod="openshift-multus/multus-q66nz" Jul 23 22:22:53.715519 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.662799 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1df4f160-29b0-42fb-a1f5-46b469eec23b-run-systemd\") pod \"ovnkube-node-hrvdq\" (UID: \"1df4f160-29b0-42fb-a1f5-46b469eec23b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrvdq" Jul 23 22:22:53.715519 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.662821 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1df4f160-29b0-42fb-a1f5-46b469eec23b-host-run-ovn-kubernetes\") pod \"ovnkube-node-hrvdq\" (UID: \"1df4f160-29b0-42fb-a1f5-46b469eec23b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrvdq" Jul 23 22:22:53.715519 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.662840 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/13d4e65e-9e85-4531-a139-0224fac37ac3-multus-cni-dir\") pod \"multus-q66nz\" (UID: \"13d4e65e-9e85-4531-a139-0224fac37ac3\") " pod="openshift-multus/multus-q66nz" Jul 23 22:22:53.715519 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.663354 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 23 22:22:53.715519 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.663402 2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-206.ec2.internal" Jul 23 22:22:53.716006 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.664201 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-206.ec2.internal"] Jul 23 22:22:53.716006 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.664335 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-22 22:17:52 +0000 UTC" deadline="2028-01-17 10:53:33.776250216 +0000 UTC" Jul 23 22:22:53.716006 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.664364 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13020h30m40.111888089s" Jul 23 22:22:53.716006 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.665364 2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 23 22:22:53.716006 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.669591 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 23 22:22:53.716006 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.669621 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-134-206.ec2.internal"] Jul 23 22:22:53.716006 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.682254 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-h25sd" Jul 23 22:22:53.716006 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.690167 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-h25sd" Jul 23 22:22:53.716006 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:53.714113 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc327b22ac949a2a8daf1ee2904cbe0b1.slice/crio-22e1173c11980f6275a6f16a99fce5524ad1d16dfb534ecb5b5d2ad9e3a9f37a WatchSource:0}: Error finding container 22e1173c11980f6275a6f16a99fce5524ad1d16dfb534ecb5b5d2ad9e3a9f37a: Status 404 returned error can't find the container with id 22e1173c11980f6275a6f16a99fce5524ad1d16dfb534ecb5b5d2ad9e3a9f37a Jul 23 22:22:53.716006 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:53.714692 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0baba1e243f7aa3ffdfefa29d6fc657e.slice/crio-0e825fbd50a03cbc45a936a6c3b0399f18ad8194085b651cd3c35e4678a102b7 WatchSource:0}: Error finding container 0e825fbd50a03cbc45a936a6c3b0399f18ad8194085b651cd3c35e4678a102b7: Status 404 returned error can't find the container with id 0e825fbd50a03cbc45a936a6c3b0399f18ad8194085b651cd3c35e4678a102b7 Jul 23 22:22:53.832863 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.719893 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 23 22:22:53.832863 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.754975 2575 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 23 22:22:53.832863 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.763054 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/13d4e65e-9e85-4531-a139-0224fac37ac3-multus-socket-dir-parent\") pod \"multus-q66nz\" (UID: \"13d4e65e-9e85-4531-a139-0224fac37ac3\") " pod="openshift-multus/multus-q66nz" Jul 23 22:22:53.832863 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.763076 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0dbcc8cc-adc8-472c-976c-f30472ad20b2-cni-binary-copy\") pod \"multus-additional-cni-plugins-2sdbj\" (UID: \"0dbcc8cc-adc8-472c-976c-f30472ad20b2\") " pod="openshift-multus/multus-additional-cni-plugins-2sdbj" Jul 23 22:22:53.832863 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.763091 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1df4f160-29b0-42fb-a1f5-46b469eec23b-host-slash\") pod \"ovnkube-node-hrvdq\" (UID: \"1df4f160-29b0-42fb-a1f5-46b469eec23b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrvdq" Jul 23 22:22:53.832863 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.763105 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/13d4e65e-9e85-4531-a139-0224fac37ac3-cni-binary-copy\") pod \"multus-q66nz\" (UID: \"13d4e65e-9e85-4531-a139-0224fac37ac3\") " pod="openshift-multus/multus-q66nz" Jul 23 22:22:53.832863 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.763123 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwhn2\" (UniqueName: \"kubernetes.io/projected/2d81f7cf-acbc-4389-b9fb-e621c3c060d4-kube-api-access-hwhn2\") pod \"network-check-target-ks6hk\" (UID: \"2d81f7cf-acbc-4389-b9fb-e621c3c060d4\") " pod="openshift-network-diagnostics/network-check-target-ks6hk" Jul 23 22:22:53.832863 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.763149 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/13d4e65e-9e85-4531-a139-0224fac37ac3-multus-socket-dir-parent\") pod \"multus-q66nz\" (UID: \"13d4e65e-9e85-4531-a139-0224fac37ac3\") " pod="openshift-multus/multus-q66nz" Jul 23 22:22:53.832863 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.763170 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1df4f160-29b0-42fb-a1f5-46b469eec23b-host-slash\") pod \"ovnkube-node-hrvdq\" (UID: \"1df4f160-29b0-42fb-a1f5-46b469eec23b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrvdq" Jul 23 22:22:53.832863 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.763200 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1df4f160-29b0-42fb-a1f5-46b469eec23b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hrvdq\" (UID: \"1df4f160-29b0-42fb-a1f5-46b469eec23b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrvdq" Jul 23 22:22:53.832863 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.763220 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dc2abf53-dbe9-411d-9da0-d36d8445fa59-lib-modules\") pod \"tuned-g48n5\" (UID: \"dc2abf53-dbe9-411d-9da0-d36d8445fa59\") " pod="openshift-cluster-node-tuning-operator/tuned-g48n5" Jul 23 22:22:53.832863 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.763240 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/29b80f76-486c-4fbb-a2ec-c66f223803ba-serviceca\") pod \"node-ca-9vqwp\" (UID: \"29b80f76-486c-4fbb-a2ec-c66f223803ba\") " pod="openshift-image-registry/node-ca-9vqwp" Jul 23 22:22:53.832863 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.763249 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1df4f160-29b0-42fb-a1f5-46b469eec23b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hrvdq\" (UID: \"1df4f160-29b0-42fb-a1f5-46b469eec23b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrvdq" Jul 23 22:22:53.832863 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.763259 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e3b1b5a6-36fa-44e7-9a9c-a2e045119f90-tmp-dir\") pod \"node-resolver-qwb6v\" (UID: \"e3b1b5a6-36fa-44e7-9a9c-a2e045119f90\") " pod="openshift-dns/node-resolver-qwb6v" Jul 23 22:22:53.832863 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.763279 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/13d4e65e-9e85-4531-a139-0224fac37ac3-multus-conf-dir\") pod \"multus-q66nz\" (UID: \"13d4e65e-9e85-4531-a139-0224fac37ac3\") " pod="openshift-multus/multus-q66nz" Jul 23 22:22:53.833408 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.763301 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0dbcc8cc-adc8-472c-976c-f30472ad20b2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2sdbj\" (UID: \"0dbcc8cc-adc8-472c-976c-f30472ad20b2\") " pod="openshift-multus/multus-additional-cni-plugins-2sdbj" Jul 23 22:22:53.833408 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.763315 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/13d4e65e-9e85-4531-a139-0224fac37ac3-multus-conf-dir\") pod \"multus-q66nz\" (UID: \"13d4e65e-9e85-4531-a139-0224fac37ac3\") " pod="openshift-multus/multus-q66nz" Jul 23 22:22:53.833408 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.763322 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8mzf\" (UniqueName: \"kubernetes.io/projected/fc3410ae-ba34-41dc-b992-c51a7bd26fd4-kube-api-access-d8mzf\") pod \"network-metrics-daemon-fd6hg\" (UID: \"fc3410ae-ba34-41dc-b992-c51a7bd26fd4\") " pod="openshift-multus/network-metrics-daemon-fd6hg" Jul 23 22:22:53.833408 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.763342 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1df4f160-29b0-42fb-a1f5-46b469eec23b-var-lib-openvswitch\") pod \"ovnkube-node-hrvdq\" (UID: \"1df4f160-29b0-42fb-a1f5-46b469eec23b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrvdq" Jul 23 22:22:53.833408 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.763409 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1df4f160-29b0-42fb-a1f5-46b469eec23b-ovnkube-config\") pod \"ovnkube-node-hrvdq\" (UID: \"1df4f160-29b0-42fb-a1f5-46b469eec23b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrvdq" Jul 23 22:22:53.833408 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.763438 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktmhk\" (UniqueName: \"kubernetes.io/projected/1df4f160-29b0-42fb-a1f5-46b469eec23b-kube-api-access-ktmhk\") pod \"ovnkube-node-hrvdq\" (UID: \"1df4f160-29b0-42fb-a1f5-46b469eec23b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrvdq" Jul 23 22:22:53.833408 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.763455 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dc2abf53-dbe9-411d-9da0-d36d8445fa59-run\") pod \"tuned-g48n5\" (UID: \"dc2abf53-dbe9-411d-9da0-d36d8445fa59\") " pod="openshift-cluster-node-tuning-operator/tuned-g48n5" Jul 23 22:22:53.833408 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.763457 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1df4f160-29b0-42fb-a1f5-46b469eec23b-var-lib-openvswitch\") pod \"ovnkube-node-hrvdq\" (UID: \"1df4f160-29b0-42fb-a1f5-46b469eec23b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrvdq" Jul 23 22:22:53.833408 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.763468 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/29b80f76-486c-4fbb-a2ec-c66f223803ba-host\") pod \"node-ca-9vqwp\" (UID: \"29b80f76-486c-4fbb-a2ec-c66f223803ba\") " pod="openshift-image-registry/node-ca-9vqwp" Jul 23 22:22:53.833408 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.763481 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13d4e65e-9e85-4531-a139-0224fac37ac3-etc-kubernetes\") pod \"multus-q66nz\" (UID: \"13d4e65e-9e85-4531-a139-0224fac37ac3\") " pod="openshift-multus/multus-q66nz" Jul 23 22:22:53.833408 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.763522 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0dbcc8cc-adc8-472c-976c-f30472ad20b2-cnibin\") pod \"multus-additional-cni-plugins-2sdbj\" (UID: \"0dbcc8cc-adc8-472c-976c-f30472ad20b2\") " pod="openshift-multus/multus-additional-cni-plugins-2sdbj" Jul 23 22:22:53.833408 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.763538 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13d4e65e-9e85-4531-a139-0224fac37ac3-etc-kubernetes\") pod \"multus-q66nz\" (UID: \"13d4e65e-9e85-4531-a139-0224fac37ac3\") " pod="openshift-multus/multus-q66nz" Jul 23 22:22:53.833408 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.763546 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0dbcc8cc-adc8-472c-976c-f30472ad20b2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2sdbj\" (UID: \"0dbcc8cc-adc8-472c-976c-f30472ad20b2\") " pod="openshift-multus/multus-additional-cni-plugins-2sdbj" Jul 23 22:22:53.833408 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.763573 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1df4f160-29b0-42fb-a1f5-46b469eec23b-node-log\") pod \"ovnkube-node-hrvdq\" (UID: \"1df4f160-29b0-42fb-a1f5-46b469eec23b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrvdq" Jul 23 22:22:53.833408 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.763572 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/29b80f76-486c-4fbb-a2ec-c66f223803ba-host\") pod \"node-ca-9vqwp\" (UID: \"29b80f76-486c-4fbb-a2ec-c66f223803ba\") " pod="openshift-image-registry/node-ca-9vqwp" Jul 23 22:22:53.833987 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.763573 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e3b1b5a6-36fa-44e7-9a9c-a2e045119f90-tmp-dir\") pod \"node-resolver-qwb6v\" (UID: \"e3b1b5a6-36fa-44e7-9a9c-a2e045119f90\") " pod="openshift-dns/node-resolver-qwb6v" Jul 23 22:22:53.833987 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.763626 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1df4f160-29b0-42fb-a1f5-46b469eec23b-env-overrides\") pod \"ovnkube-node-hrvdq\" (UID: \"1df4f160-29b0-42fb-a1f5-46b469eec23b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrvdq" Jul 23 22:22:53.833987 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.763631 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0dbcc8cc-adc8-472c-976c-f30472ad20b2-cni-binary-copy\") pod \"multus-additional-cni-plugins-2sdbj\" (UID: \"0dbcc8cc-adc8-472c-976c-f30472ad20b2\") " pod="openshift-multus/multus-additional-cni-plugins-2sdbj" Jul 23 22:22:53.833987 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.763646 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dc2abf53-dbe9-411d-9da0-d36d8445fa59-etc-sysctl-conf\") pod \"tuned-g48n5\" (UID: \"dc2abf53-dbe9-411d-9da0-d36d8445fa59\") " pod="openshift-cluster-node-tuning-operator/tuned-g48n5" Jul 23 22:22:53.833987 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.763652 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/13d4e65e-9e85-4531-a139-0224fac37ac3-cni-binary-copy\") pod \"multus-q66nz\" (UID: \"13d4e65e-9e85-4531-a139-0224fac37ac3\") " pod="openshift-multus/multus-q66nz" Jul 23 22:22:53.833987 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.763667 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dc2abf53-dbe9-411d-9da0-d36d8445fa59-host\") pod \"tuned-g48n5\" (UID: \"dc2abf53-dbe9-411d-9da0-d36d8445fa59\") " pod="openshift-cluster-node-tuning-operator/tuned-g48n5" Jul 23 22:22:53.833987 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.763689 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dc2abf53-dbe9-411d-9da0-d36d8445fa59-run\") pod \"tuned-g48n5\" (UID: \"dc2abf53-dbe9-411d-9da0-d36d8445fa59\") " pod="openshift-cluster-node-tuning-operator/tuned-g48n5" Jul 23 22:22:53.833987 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.763693 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/29b80f76-486c-4fbb-a2ec-c66f223803ba-serviceca\") pod \"node-ca-9vqwp\" (UID: \"29b80f76-486c-4fbb-a2ec-c66f223803ba\") " pod="openshift-image-registry/node-ca-9vqwp" Jul 23 22:22:53.833987 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.763759 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dc2abf53-dbe9-411d-9da0-d36d8445fa59-lib-modules\") pod \"tuned-g48n5\" (UID: \"dc2abf53-dbe9-411d-9da0-d36d8445fa59\") " pod="openshift-cluster-node-tuning-operator/tuned-g48n5" Jul 23 22:22:53.833987 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.763820 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1df4f160-29b0-42fb-a1f5-46b469eec23b-node-log\") pod \"ovnkube-node-hrvdq\" (UID: \"1df4f160-29b0-42fb-a1f5-46b469eec23b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrvdq" Jul 23 22:22:53.833987 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.763855 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0dbcc8cc-adc8-472c-976c-f30472ad20b2-cnibin\") pod \"multus-additional-cni-plugins-2sdbj\" (UID: \"0dbcc8cc-adc8-472c-976c-f30472ad20b2\") " pod="openshift-multus/multus-additional-cni-plugins-2sdbj" Jul 23 22:22:53.833987 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.763868 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0dbcc8cc-adc8-472c-976c-f30472ad20b2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2sdbj\" (UID: \"0dbcc8cc-adc8-472c-976c-f30472ad20b2\") " pod="openshift-multus/multus-additional-cni-plugins-2sdbj" Jul 23 22:22:53.833987 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.763896 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dc2abf53-dbe9-411d-9da0-d36d8445fa59-host\") pod \"tuned-g48n5\" (UID: \"dc2abf53-dbe9-411d-9da0-d36d8445fa59\") " pod="openshift-cluster-node-tuning-operator/tuned-g48n5" Jul 23 22:22:53.833987 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.763979 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1df4f160-29b0-42fb-a1f5-46b469eec23b-ovnkube-config\") pod \"ovnkube-node-hrvdq\" (UID: \"1df4f160-29b0-42fb-a1f5-46b469eec23b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrvdq" Jul 23 22:22:53.833987 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.764015 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1df4f160-29b0-42fb-a1f5-46b469eec23b-env-overrides\") pod \"ovnkube-node-hrvdq\" (UID: \"1df4f160-29b0-42fb-a1f5-46b469eec23b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrvdq" Jul 23 22:22:53.834529 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.764338 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/74793765-85c1-4990-8cb0-892552debf77-konnectivity-ca\") pod \"konnectivity-agent-6t59s\" (UID: \"74793765-85c1-4990-8cb0-892552debf77\") " pod="kube-system/konnectivity-agent-6t59s" Jul 23 22:22:53.834529 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.765750 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0dbcc8cc-adc8-472c-976c-f30472ad20b2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2sdbj\" (UID: \"0dbcc8cc-adc8-472c-976c-f30472ad20b2\") " pod="openshift-multus/multus-additional-cni-plugins-2sdbj" Jul 23 22:22:53.834529 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.763812 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/74793765-85c1-4990-8cb0-892552debf77-konnectivity-ca\") pod \"konnectivity-agent-6t59s\" (UID: \"74793765-85c1-4990-8cb0-892552debf77\") " pod="kube-system/konnectivity-agent-6t59s" Jul 23 22:22:53.834529 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.766408 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/13d4e65e-9e85-4531-a139-0224fac37ac3-cnibin\") pod \"multus-q66nz\" (UID: \"13d4e65e-9e85-4531-a139-0224fac37ac3\") " pod="openshift-multus/multus-q66nz" Jul 23 22:22:53.834529 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.766423 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0dbcc8cc-adc8-472c-976c-f30472ad20b2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2sdbj\" (UID: \"0dbcc8cc-adc8-472c-976c-f30472ad20b2\") " pod="openshift-multus/multus-additional-cni-plugins-2sdbj" Jul 23 22:22:53.834529 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.766437 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dc2abf53-dbe9-411d-9da0-d36d8445fa59-etc-sysctl-d\") pod \"tuned-g48n5\" (UID: \"dc2abf53-dbe9-411d-9da0-d36d8445fa59\") " pod="openshift-cluster-node-tuning-operator/tuned-g48n5" Jul 23 22:22:53.834529 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.766454 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dc2abf53-dbe9-411d-9da0-d36d8445fa59-etc-systemd\") pod \"tuned-g48n5\" (UID: \"dc2abf53-dbe9-411d-9da0-d36d8445fa59\") " pod="openshift-cluster-node-tuning-operator/tuned-g48n5" Jul 23 22:22:53.834529 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.766454 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dc2abf53-dbe9-411d-9da0-d36d8445fa59-etc-sysctl-conf\") pod \"tuned-g48n5\" (UID: \"dc2abf53-dbe9-411d-9da0-d36d8445fa59\") " pod="openshift-cluster-node-tuning-operator/tuned-g48n5" Jul 23 22:22:53.834529 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.766466 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/13d4e65e-9e85-4531-a139-0224fac37ac3-os-release\") pod \"multus-q66nz\" (UID: \"13d4e65e-9e85-4531-a139-0224fac37ac3\") " pod="openshift-multus/multus-q66nz" Jul 23 22:22:53.834529 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.766482 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/13d4e65e-9e85-4531-a139-0224fac37ac3-host-run-k8s-cni-cncf-io\") pod \"multus-q66nz\" (UID: \"13d4e65e-9e85-4531-a139-0224fac37ac3\") " pod="openshift-multus/multus-q66nz" Jul 23 22:22:53.834529 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.766507 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/13d4e65e-9e85-4531-a139-0224fac37ac3-cnibin\") pod \"multus-q66nz\" (UID: \"13d4e65e-9e85-4531-a139-0224fac37ac3\") " pod="openshift-multus/multus-q66nz" Jul 23 22:22:53.834529 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.766521 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/13d4e65e-9e85-4531-a139-0224fac37ac3-host-var-lib-kubelet\") pod \"multus-q66nz\" (UID: \"13d4e65e-9e85-4531-a139-0224fac37ac3\") " pod="openshift-multus/multus-q66nz" Jul 23 22:22:53.834529 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.766534 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dc2abf53-dbe9-411d-9da0-d36d8445fa59-etc-sysctl-d\") pod \"tuned-g48n5\" (UID: \"dc2abf53-dbe9-411d-9da0-d36d8445fa59\") " pod="openshift-cluster-node-tuning-operator/tuned-g48n5" Jul 23 22:22:53.834529 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.766539 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/13d4e65e-9e85-4531-a139-0224fac37ac3-host-run-k8s-cni-cncf-io\") pod \"multus-q66nz\" (UID: \"13d4e65e-9e85-4531-a139-0224fac37ac3\") " pod="openshift-multus/multus-q66nz" Jul 23 22:22:53.834529 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.766539 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dc2abf53-dbe9-411d-9da0-d36d8445fa59-etc-systemd\") pod \"tuned-g48n5\" (UID: \"dc2abf53-dbe9-411d-9da0-d36d8445fa59\") " pod="openshift-cluster-node-tuning-operator/tuned-g48n5" Jul 23 22:22:53.835080 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.766550 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/13d4e65e-9e85-4531-a139-0224fac37ac3-os-release\") pod \"multus-q66nz\" (UID: \"13d4e65e-9e85-4531-a139-0224fac37ac3\") " pod="openshift-multus/multus-q66nz" Jul 23 22:22:53.835080 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.766556 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f9e1354d-23f7-472b-8486-a9eccb352a8e-iptables-alerter-script\") pod \"iptables-alerter-pkrss\" (UID: \"f9e1354d-23f7-472b-8486-a9eccb352a8e\") " pod="openshift-network-operator/iptables-alerter-pkrss" Jul 23 22:22:53.835080 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.766573 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/13d4e65e-9e85-4531-a139-0224fac37ac3-host-var-lib-kubelet\") pod \"multus-q66nz\" (UID: \"13d4e65e-9e85-4531-a139-0224fac37ac3\") " pod="openshift-multus/multus-q66nz" Jul 23 22:22:53.835080 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.766592 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f9e1354d-23f7-472b-8486-a9eccb352a8e-host-slash\") pod \"iptables-alerter-pkrss\" (UID: \"f9e1354d-23f7-472b-8486-a9eccb352a8e\") " pod="openshift-network-operator/iptables-alerter-pkrss" Jul 23 22:22:53.835080 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.766616 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1df4f160-29b0-42fb-a1f5-46b469eec23b-host-kubelet\") pod \"ovnkube-node-hrvdq\" (UID: \"1df4f160-29b0-42fb-a1f5-46b469eec23b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrvdq" Jul 23 22:22:53.835080 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.766637 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1df4f160-29b0-42fb-a1f5-46b469eec23b-host-cni-netd\") pod \"ovnkube-node-hrvdq\" (UID: \"1df4f160-29b0-42fb-a1f5-46b469eec23b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrvdq" Jul 23 22:22:53.835080 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.766632 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f9e1354d-23f7-472b-8486-a9eccb352a8e-host-slash\") pod \"iptables-alerter-pkrss\" (UID: \"f9e1354d-23f7-472b-8486-a9eccb352a8e\") " pod="openshift-network-operator/iptables-alerter-pkrss" Jul 23 22:22:53.835080 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.766661 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2jjv\" (UniqueName: \"kubernetes.io/projected/f9e1354d-23f7-472b-8486-a9eccb352a8e-kube-api-access-t2jjv\") pod \"iptables-alerter-pkrss\" (UID: \"f9e1354d-23f7-472b-8486-a9eccb352a8e\") " pod="openshift-network-operator/iptables-alerter-pkrss" Jul 23 22:22:53.835080 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.766676 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1df4f160-29b0-42fb-a1f5-46b469eec23b-host-cni-netd\") pod \"ovnkube-node-hrvdq\" (UID: \"1df4f160-29b0-42fb-a1f5-46b469eec23b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrvdq" Jul 23 22:22:53.835080 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.766685 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlpzm\" (UniqueName: \"kubernetes.io/projected/6e8b3555-1c33-4b27-8431-caf4c5b1a347-kube-api-access-jlpzm\") pod \"aws-ebs-csi-driver-node-dvvl7\" (UID: \"6e8b3555-1c33-4b27-8431-caf4c5b1a347\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dvvl7" Jul 23 22:22:53.835080 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.766712 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/81890460-aa07-4749-aadd-909c876b9244-original-pull-secret\") pod \"global-pull-secret-syncer-pl657\" (UID: \"81890460-aa07-4749-aadd-909c876b9244\") " pod="kube-system/global-pull-secret-syncer-pl657" Jul 23 22:22:53.835080 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.766735 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1df4f160-29b0-42fb-a1f5-46b469eec23b-etc-openvswitch\") pod \"ovnkube-node-hrvdq\" (UID: \"1df4f160-29b0-42fb-a1f5-46b469eec23b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrvdq" Jul 23 22:22:53.835080 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.766665 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1df4f160-29b0-42fb-a1f5-46b469eec23b-host-kubelet\") pod \"ovnkube-node-hrvdq\" (UID: \"1df4f160-29b0-42fb-a1f5-46b469eec23b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrvdq" Jul 23 22:22:53.835080 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.766755 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dc2abf53-dbe9-411d-9da0-d36d8445fa59-sys\") pod \"tuned-g48n5\" (UID: \"dc2abf53-dbe9-411d-9da0-d36d8445fa59\") " pod="openshift-cluster-node-tuning-operator/tuned-g48n5" Jul 23 22:22:53.835583 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.766777 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dc2abf53-dbe9-411d-9da0-d36d8445fa59-etc-tuned\") pod \"tuned-g48n5\" (UID: \"dc2abf53-dbe9-411d-9da0-d36d8445fa59\") " pod="openshift-cluster-node-tuning-operator/tuned-g48n5" Jul 23 22:22:53.835583 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.766799 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6e8b3555-1c33-4b27-8431-caf4c5b1a347-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dvvl7\" (UID: \"6e8b3555-1c33-4b27-8431-caf4c5b1a347\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dvvl7" Jul 23 22:22:53.835583 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.766803 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1df4f160-29b0-42fb-a1f5-46b469eec23b-etc-openvswitch\") pod \"ovnkube-node-hrvdq\" (UID: \"1df4f160-29b0-42fb-a1f5-46b469eec23b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrvdq" Jul 23 22:22:53.835583 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.766805 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dc2abf53-dbe9-411d-9da0-d36d8445fa59-sys\") pod \"tuned-g48n5\" (UID: \"dc2abf53-dbe9-411d-9da0-d36d8445fa59\") " pod="openshift-cluster-node-tuning-operator/tuned-g48n5" Jul 23 22:22:53.835583 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.766838 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0dbcc8cc-adc8-472c-976c-f30472ad20b2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2sdbj\" (UID: \"0dbcc8cc-adc8-472c-976c-f30472ad20b2\") " pod="openshift-multus/multus-additional-cni-plugins-2sdbj" Jul 23 22:22:53.835583 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.766822 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6e8b3555-1c33-4b27-8431-caf4c5b1a347-etc-selinux\") pod \"aws-ebs-csi-driver-node-dvvl7\" (UID: \"6e8b3555-1c33-4b27-8431-caf4c5b1a347\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dvvl7" Jul 23 22:22:53.835583 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.766875 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6e8b3555-1c33-4b27-8431-caf4c5b1a347-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dvvl7\" (UID: \"6e8b3555-1c33-4b27-8431-caf4c5b1a347\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dvvl7" Jul 23 22:22:53.835583 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.766880 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/81890460-aa07-4749-aadd-909c876b9244-kubelet-config\") pod \"global-pull-secret-syncer-pl657\" (UID: \"81890460-aa07-4749-aadd-909c876b9244\") " pod="kube-system/global-pull-secret-syncer-pl657" Jul 23 22:22:53.835583 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.766908 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1df4f160-29b0-42fb-a1f5-46b469eec23b-run-openvswitch\") pod \"ovnkube-node-hrvdq\" (UID: \"1df4f160-29b0-42fb-a1f5-46b469eec23b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrvdq" Jul 23 22:22:53.835583 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.766928 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1df4f160-29b0-42fb-a1f5-46b469eec23b-run-openvswitch\") pod \"ovnkube-node-hrvdq\" (UID: \"1df4f160-29b0-42fb-a1f5-46b469eec23b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrvdq" Jul 23 22:22:53.835583 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.766929 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dc2abf53-dbe9-411d-9da0-d36d8445fa59-etc-sysconfig\") pod \"tuned-g48n5\" (UID: \"dc2abf53-dbe9-411d-9da0-d36d8445fa59\") " pod="openshift-cluster-node-tuning-operator/tuned-g48n5" Jul 23 22:22:53.835583 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.766948 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f9e1354d-23f7-472b-8486-a9eccb352a8e-iptables-alerter-script\") pod \"iptables-alerter-pkrss\" (UID: \"f9e1354d-23f7-472b-8486-a9eccb352a8e\") " pod="openshift-network-operator/iptables-alerter-pkrss" Jul 23 22:22:53.835583 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.766954 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dc2abf53-dbe9-411d-9da0-d36d8445fa59-etc-sysconfig\") pod \"tuned-g48n5\" (UID: \"dc2abf53-dbe9-411d-9da0-d36d8445fa59\") " pod="openshift-cluster-node-tuning-operator/tuned-g48n5" Jul 23 22:22:53.835583 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.766910 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6e8b3555-1c33-4b27-8431-caf4c5b1a347-etc-selinux\") pod \"aws-ebs-csi-driver-node-dvvl7\" (UID: \"6e8b3555-1c33-4b27-8431-caf4c5b1a347\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dvvl7" Jul 23 22:22:53.836181 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.766956 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65mqs\" (UniqueName: \"kubernetes.io/projected/dc2abf53-dbe9-411d-9da0-d36d8445fa59-kube-api-access-65mqs\") pod \"tuned-g48n5\" (UID: \"dc2abf53-dbe9-411d-9da0-d36d8445fa59\") " pod="openshift-cluster-node-tuning-operator/tuned-g48n5" Jul 23 22:22:53.836181 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.766989 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/74793765-85c1-4990-8cb0-892552debf77-agent-certs\") pod \"konnectivity-agent-6t59s\" (UID: \"74793765-85c1-4990-8cb0-892552debf77\") " pod="kube-system/konnectivity-agent-6t59s" Jul 23 22:22:53.836181 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.767003 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrvg8\" (UniqueName: \"kubernetes.io/projected/e3b1b5a6-36fa-44e7-9a9c-a2e045119f90-kube-api-access-mrvg8\") pod \"node-resolver-qwb6v\" (UID: \"e3b1b5a6-36fa-44e7-9a9c-a2e045119f90\") " pod="openshift-dns/node-resolver-qwb6v" Jul 23 22:22:53.836181 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.767003 2575 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 23 22:22:53.836181 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.767038 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/13d4e65e-9e85-4531-a139-0224fac37ac3-host-run-netns\") pod \"multus-q66nz\" (UID: \"13d4e65e-9e85-4531-a139-0224fac37ac3\") " pod="openshift-multus/multus-q66nz" Jul 23 22:22:53.836181 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.767052 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6e8b3555-1c33-4b27-8431-caf4c5b1a347-registration-dir\") pod \"aws-ebs-csi-driver-node-dvvl7\" (UID: \"6e8b3555-1c33-4b27-8431-caf4c5b1a347\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dvvl7" Jul 23 22:22:53.836181 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.767068 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc3410ae-ba34-41dc-b992-c51a7bd26fd4-metrics-certs\") pod \"network-metrics-daemon-fd6hg\" (UID: \"fc3410ae-ba34-41dc-b992-c51a7bd26fd4\") " pod="openshift-multus/network-metrics-daemon-fd6hg" Jul 23 22:22:53.836181 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.767086 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcmsz\" (UniqueName: \"kubernetes.io/projected/13d4e65e-9e85-4531-a139-0224fac37ac3-kube-api-access-wcmsz\") pod \"multus-q66nz\" (UID: \"13d4e65e-9e85-4531-a139-0224fac37ac3\") " pod="openshift-multus/multus-q66nz" Jul 23 22:22:53.836181 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.767097 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/13d4e65e-9e85-4531-a139-0224fac37ac3-host-run-netns\") pod \"multus-q66nz\" (UID: \"13d4e65e-9e85-4531-a139-0224fac37ac3\") " pod="openshift-multus/multus-q66nz" Jul 23 22:22:53.836181 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.767118 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6e8b3555-1c33-4b27-8431-caf4c5b1a347-registration-dir\") pod \"aws-ebs-csi-driver-node-dvvl7\" (UID: \"6e8b3555-1c33-4b27-8431-caf4c5b1a347\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dvvl7" Jul 23 22:22:53.836181 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.767100 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1df4f160-29b0-42fb-a1f5-46b469eec23b-run-systemd\") pod \"ovnkube-node-hrvdq\" (UID: \"1df4f160-29b0-42fb-a1f5-46b469eec23b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrvdq" Jul 23 22:22:53.836181 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.767140 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1df4f160-29b0-42fb-a1f5-46b469eec23b-run-systemd\") pod \"ovnkube-node-hrvdq\" (UID: \"1df4f160-29b0-42fb-a1f5-46b469eec23b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrvdq" Jul 23 22:22:53.836181 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:22:53.767159 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 22:22:53.836181 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.767163 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1df4f160-29b0-42fb-a1f5-46b469eec23b-host-run-ovn-kubernetes\") pod \"ovnkube-node-hrvdq\" (UID: \"1df4f160-29b0-42fb-a1f5-46b469eec23b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrvdq" Jul 23 22:22:53.836181 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.767178 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1df4f160-29b0-42fb-a1f5-46b469eec23b-host-run-ovn-kubernetes\") pod \"ovnkube-node-hrvdq\" (UID: \"1df4f160-29b0-42fb-a1f5-46b469eec23b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrvdq" Jul 23 22:22:53.836616 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.767188 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/13d4e65e-9e85-4531-a139-0224fac37ac3-multus-cni-dir\") pod \"multus-q66nz\" (UID: \"13d4e65e-9e85-4531-a139-0224fac37ac3\") " pod="openshift-multus/multus-q66nz" Jul 23 22:22:53.836616 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:22:53.767222 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc3410ae-ba34-41dc-b992-c51a7bd26fd4-metrics-certs podName:fc3410ae-ba34-41dc-b992-c51a7bd26fd4 nodeName:}" failed. No retries permitted until 2026-07-23 22:22:54.267189899 +0000 UTC m=+1.987187161 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fc3410ae-ba34-41dc-b992-c51a7bd26fd4-metrics-certs") pod "network-metrics-daemon-fd6hg" (UID: "fc3410ae-ba34-41dc-b992-c51a7bd26fd4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 22:22:53.836616 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.767267 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/13d4e65e-9e85-4531-a139-0224fac37ac3-multus-cni-dir\") pod \"multus-q66nz\" (UID: \"13d4e65e-9e85-4531-a139-0224fac37ac3\") " pod="openshift-multus/multus-q66nz" Jul 23 22:22:53.836616 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.767279 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/13d4e65e-9e85-4531-a139-0224fac37ac3-host-var-lib-cni-bin\") pod \"multus-q66nz\" (UID: \"13d4e65e-9e85-4531-a139-0224fac37ac3\") " pod="openshift-multus/multus-q66nz" Jul 23 22:22:53.836616 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.767307 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6e8b3555-1c33-4b27-8431-caf4c5b1a347-socket-dir\") pod \"aws-ebs-csi-driver-node-dvvl7\" (UID: \"6e8b3555-1c33-4b27-8431-caf4c5b1a347\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dvvl7" Jul 23 22:22:53.836616 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.767347 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/81890460-aa07-4749-aadd-909c876b9244-dbus\") pod \"global-pull-secret-syncer-pl657\" (UID: \"81890460-aa07-4749-aadd-909c876b9244\") " pod="kube-system/global-pull-secret-syncer-pl657" Jul 23 22:22:53.836616 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.767350 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/13d4e65e-9e85-4531-a139-0224fac37ac3-host-var-lib-cni-bin\") pod \"multus-q66nz\" (UID: \"13d4e65e-9e85-4531-a139-0224fac37ac3\") " pod="openshift-multus/multus-q66nz" Jul 23 22:22:53.836616 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.767378 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0dbcc8cc-adc8-472c-976c-f30472ad20b2-os-release\") pod \"multus-additional-cni-plugins-2sdbj\" (UID: \"0dbcc8cc-adc8-472c-976c-f30472ad20b2\") " pod="openshift-multus/multus-additional-cni-plugins-2sdbj" Jul 23 22:22:53.836616 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.767398 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dc2abf53-dbe9-411d-9da0-d36d8445fa59-tmp\") pod \"tuned-g48n5\" (UID: \"dc2abf53-dbe9-411d-9da0-d36d8445fa59\") " pod="openshift-cluster-node-tuning-operator/tuned-g48n5" Jul 23 22:22:53.836616 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.767410 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6e8b3555-1c33-4b27-8431-caf4c5b1a347-socket-dir\") pod \"aws-ebs-csi-driver-node-dvvl7\" (UID: \"6e8b3555-1c33-4b27-8431-caf4c5b1a347\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dvvl7" Jul 23 22:22:53.836616 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.767413 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/13d4e65e-9e85-4531-a139-0224fac37ac3-hostroot\") pod \"multus-q66nz\" (UID: \"13d4e65e-9e85-4531-a139-0224fac37ac3\") " pod="openshift-multus/multus-q66nz" Jul 23 22:22:53.836616 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.767438 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/13d4e65e-9e85-4531-a139-0224fac37ac3-hostroot\") pod \"multus-q66nz\" (UID: \"13d4e65e-9e85-4531-a139-0224fac37ac3\") " pod="openshift-multus/multus-q66nz" Jul 23 22:22:53.836616 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.767443 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6e8b3555-1c33-4b27-8431-caf4c5b1a347-sys-fs\") pod \"aws-ebs-csi-driver-node-dvvl7\" (UID: \"6e8b3555-1c33-4b27-8431-caf4c5b1a347\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dvvl7" Jul 23 22:22:53.836616 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.767483 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0dbcc8cc-adc8-472c-976c-f30472ad20b2-system-cni-dir\") pod \"multus-additional-cni-plugins-2sdbj\" (UID: \"0dbcc8cc-adc8-472c-976c-f30472ad20b2\") " pod="openshift-multus/multus-additional-cni-plugins-2sdbj" Jul 23 22:22:53.837056 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.767487 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0dbcc8cc-adc8-472c-976c-f30472ad20b2-os-release\") pod \"multus-additional-cni-plugins-2sdbj\" (UID: \"0dbcc8cc-adc8-472c-976c-f30472ad20b2\") " pod="openshift-multus/multus-additional-cni-plugins-2sdbj" Jul 23 22:22:53.837056 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.767492 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6e8b3555-1c33-4b27-8431-caf4c5b1a347-sys-fs\") pod \"aws-ebs-csi-driver-node-dvvl7\" (UID: \"6e8b3555-1c33-4b27-8431-caf4c5b1a347\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dvvl7" Jul 23 22:22:53.837056 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.767506 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1df4f160-29b0-42fb-a1f5-46b469eec23b-log-socket\") pod \"ovnkube-node-hrvdq\" (UID: \"1df4f160-29b0-42fb-a1f5-46b469eec23b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrvdq" Jul 23 22:22:53.837056 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.767526 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0dbcc8cc-adc8-472c-976c-f30472ad20b2-system-cni-dir\") pod \"multus-additional-cni-plugins-2sdbj\" (UID: \"0dbcc8cc-adc8-472c-976c-f30472ad20b2\") " pod="openshift-multus/multus-additional-cni-plugins-2sdbj" Jul 23 22:22:53.837056 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.767547 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1df4f160-29b0-42fb-a1f5-46b469eec23b-host-cni-bin\") pod \"ovnkube-node-hrvdq\" (UID: \"1df4f160-29b0-42fb-a1f5-46b469eec23b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrvdq" Jul 23 22:22:53.837056 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.767583 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1df4f160-29b0-42fb-a1f5-46b469eec23b-host-cni-bin\") pod \"ovnkube-node-hrvdq\" (UID: \"1df4f160-29b0-42fb-a1f5-46b469eec23b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrvdq" Jul 23 22:22:53.837056 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.767624 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1df4f160-29b0-42fb-a1f5-46b469eec23b-run-ovn\") pod \"ovnkube-node-hrvdq\" (UID: \"1df4f160-29b0-42fb-a1f5-46b469eec23b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrvdq" Jul 23 22:22:53.837056 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.767648 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pl5x4\" (UniqueName: \"kubernetes.io/projected/29b80f76-486c-4fbb-a2ec-c66f223803ba-kube-api-access-pl5x4\") pod \"node-ca-9vqwp\" (UID: \"29b80f76-486c-4fbb-a2ec-c66f223803ba\") " pod="openshift-image-registry/node-ca-9vqwp" Jul 23 22:22:53.837056 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.767656 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1df4f160-29b0-42fb-a1f5-46b469eec23b-log-socket\") pod \"ovnkube-node-hrvdq\" (UID: \"1df4f160-29b0-42fb-a1f5-46b469eec23b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrvdq" Jul 23 22:22:53.837056 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.767657 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1df4f160-29b0-42fb-a1f5-46b469eec23b-run-ovn\") pod \"ovnkube-node-hrvdq\" (UID: \"1df4f160-29b0-42fb-a1f5-46b469eec23b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrvdq" Jul 23 22:22:53.837056 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.767723 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1df4f160-29b0-42fb-a1f5-46b469eec23b-systemd-units\") pod \"ovnkube-node-hrvdq\" (UID: \"1df4f160-29b0-42fb-a1f5-46b469eec23b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrvdq" Jul 23 22:22:53.837056 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.767750 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1df4f160-29b0-42fb-a1f5-46b469eec23b-ovn-node-metrics-cert\") pod \"ovnkube-node-hrvdq\" (UID: \"1df4f160-29b0-42fb-a1f5-46b469eec23b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrvdq" Jul 23 22:22:53.837056 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.767780 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1df4f160-29b0-42fb-a1f5-46b469eec23b-ovnkube-script-lib\") pod \"ovnkube-node-hrvdq\" (UID: \"1df4f160-29b0-42fb-a1f5-46b469eec23b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrvdq" Jul 23 22:22:53.837056 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.767824 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dc2abf53-dbe9-411d-9da0-d36d8445fa59-etc-kubernetes\") pod \"tuned-g48n5\" (UID: \"dc2abf53-dbe9-411d-9da0-d36d8445fa59\") " pod="openshift-cluster-node-tuning-operator/tuned-g48n5" Jul 23 22:22:53.837056 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.767827 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1df4f160-29b0-42fb-a1f5-46b469eec23b-systemd-units\") pod \"ovnkube-node-hrvdq\" (UID: \"1df4f160-29b0-42fb-a1f5-46b469eec23b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrvdq" Jul 23 22:22:53.837524 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.767856 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e3b1b5a6-36fa-44e7-9a9c-a2e045119f90-hosts-file\") pod \"node-resolver-qwb6v\" (UID: \"e3b1b5a6-36fa-44e7-9a9c-a2e045119f90\") " pod="openshift-dns/node-resolver-qwb6v" Jul 23 22:22:53.837524 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.767877 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/13d4e65e-9e85-4531-a139-0224fac37ac3-system-cni-dir\") pod \"multus-q66nz\" (UID: \"13d4e65e-9e85-4531-a139-0224fac37ac3\") " pod="openshift-multus/multus-q66nz" Jul 23 22:22:53.837524 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.767893 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dc2abf53-dbe9-411d-9da0-d36d8445fa59-etc-kubernetes\") pod \"tuned-g48n5\" (UID: \"dc2abf53-dbe9-411d-9da0-d36d8445fa59\") " pod="openshift-cluster-node-tuning-operator/tuned-g48n5" Jul 23 22:22:53.837524 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.767900 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/13d4e65e-9e85-4531-a139-0224fac37ac3-host-var-lib-cni-multus\") pod \"multus-q66nz\" (UID: \"13d4e65e-9e85-4531-a139-0224fac37ac3\") " pod="openshift-multus/multus-q66nz" Jul 23 22:22:53.837524 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.767923 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/13d4e65e-9e85-4531-a139-0224fac37ac3-host-run-multus-certs\") pod \"multus-q66nz\" (UID: \"13d4e65e-9e85-4531-a139-0224fac37ac3\") " pod="openshift-multus/multus-q66nz" Jul 23 22:22:53.837524 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.767936 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e3b1b5a6-36fa-44e7-9a9c-a2e045119f90-hosts-file\") pod \"node-resolver-qwb6v\" (UID: \"e3b1b5a6-36fa-44e7-9a9c-a2e045119f90\") " pod="openshift-dns/node-resolver-qwb6v" Jul 23 22:22:53.837524 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.767945 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1df4f160-29b0-42fb-a1f5-46b469eec23b-host-run-netns\") pod \"ovnkube-node-hrvdq\" (UID: \"1df4f160-29b0-42fb-a1f5-46b469eec23b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrvdq" Jul 23 22:22:53.837524 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.767974 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/13d4e65e-9e85-4531-a139-0224fac37ac3-host-var-lib-cni-multus\") pod \"multus-q66nz\" (UID: \"13d4e65e-9e85-4531-a139-0224fac37ac3\") " pod="openshift-multus/multus-q66nz" Jul 23 22:22:53.837524 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.767966 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/13d4e65e-9e85-4531-a139-0224fac37ac3-multus-daemon-config\") pod \"multus-q66nz\" (UID: \"13d4e65e-9e85-4531-a139-0224fac37ac3\") " pod="openshift-multus/multus-q66nz" Jul 23 22:22:53.837524 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.767994 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/13d4e65e-9e85-4531-a139-0224fac37ac3-system-cni-dir\") pod \"multus-q66nz\" (UID: \"13d4e65e-9e85-4531-a139-0224fac37ac3\") " pod="openshift-multus/multus-q66nz" Jul 23 22:22:53.837524 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.768013 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6e8b3555-1c33-4b27-8431-caf4c5b1a347-device-dir\") pod \"aws-ebs-csi-driver-node-dvvl7\" (UID: \"6e8b3555-1c33-4b27-8431-caf4c5b1a347\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dvvl7" Jul 23 22:22:53.837524 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.768077 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/13d4e65e-9e85-4531-a139-0224fac37ac3-host-run-multus-certs\") pod \"multus-q66nz\" (UID: \"13d4e65e-9e85-4531-a139-0224fac37ac3\") " pod="openshift-multus/multus-q66nz" Jul 23 22:22:53.837524 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.768113 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4h9rg\" (UniqueName: \"kubernetes.io/projected/0dbcc8cc-adc8-472c-976c-f30472ad20b2-kube-api-access-4h9rg\") pod \"multus-additional-cni-plugins-2sdbj\" (UID: \"0dbcc8cc-adc8-472c-976c-f30472ad20b2\") " pod="openshift-multus/multus-additional-cni-plugins-2sdbj" Jul 23 22:22:53.837524 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.768140 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dc2abf53-dbe9-411d-9da0-d36d8445fa59-etc-modprobe-d\") pod \"tuned-g48n5\" (UID: \"dc2abf53-dbe9-411d-9da0-d36d8445fa59\") " pod="openshift-cluster-node-tuning-operator/tuned-g48n5" Jul 23 22:22:53.837524 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.768160 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dc2abf53-dbe9-411d-9da0-d36d8445fa59-var-lib-kubelet\") pod \"tuned-g48n5\" (UID: \"dc2abf53-dbe9-411d-9da0-d36d8445fa59\") " pod="openshift-cluster-node-tuning-operator/tuned-g48n5" Jul 23 22:22:53.837943 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.768251 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dc2abf53-dbe9-411d-9da0-d36d8445fa59-var-lib-kubelet\") pod \"tuned-g48n5\" (UID: \"dc2abf53-dbe9-411d-9da0-d36d8445fa59\") " pod="openshift-cluster-node-tuning-operator/tuned-g48n5" Jul 23 22:22:53.837943 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.768293 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6e8b3555-1c33-4b27-8431-caf4c5b1a347-device-dir\") pod \"aws-ebs-csi-driver-node-dvvl7\" (UID: \"6e8b3555-1c33-4b27-8431-caf4c5b1a347\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dvvl7" Jul 23 22:22:53.837943 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.768328 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1df4f160-29b0-42fb-a1f5-46b469eec23b-host-run-netns\") pod \"ovnkube-node-hrvdq\" (UID: \"1df4f160-29b0-42fb-a1f5-46b469eec23b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrvdq" Jul 23 22:22:53.837943 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.768407 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/13d4e65e-9e85-4531-a139-0224fac37ac3-multus-daemon-config\") pod \"multus-q66nz\" (UID: \"13d4e65e-9e85-4531-a139-0224fac37ac3\") " pod="openshift-multus/multus-q66nz" Jul 23 22:22:53.837943 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.768407 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1df4f160-29b0-42fb-a1f5-46b469eec23b-ovnkube-script-lib\") pod \"ovnkube-node-hrvdq\" (UID: \"1df4f160-29b0-42fb-a1f5-46b469eec23b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrvdq" Jul 23 22:22:53.837943 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.768533 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dc2abf53-dbe9-411d-9da0-d36d8445fa59-etc-modprobe-d\") pod \"tuned-g48n5\" (UID: \"dc2abf53-dbe9-411d-9da0-d36d8445fa59\") " pod="openshift-cluster-node-tuning-operator/tuned-g48n5" Jul 23 22:22:53.837943 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:22:53.768581 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 22:22:53.837943 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:22:53.768599 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 22:22:53.837943 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:22:53.768621 2575 projected.go:196] Error preparing data for projected volume kube-api-access-hwhn2 for pod openshift-network-diagnostics/network-check-target-ks6hk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 22:22:53.837943 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:22:53.768681 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2d81f7cf-acbc-4389-b9fb-e621c3c060d4-kube-api-access-hwhn2 podName:2d81f7cf-acbc-4389-b9fb-e621c3c060d4 nodeName:}" failed. No retries permitted until 2026-07-23 22:22:54.268666762 +0000 UTC m=+1.988664023 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-hwhn2" (UniqueName: "kubernetes.io/projected/2d81f7cf-acbc-4389-b9fb-e621c3c060d4-kube-api-access-hwhn2") pod "network-check-target-ks6hk" (UID: "2d81f7cf-acbc-4389-b9fb-e621c3c060d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 22:22:53.837943 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.769909 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dc2abf53-dbe9-411d-9da0-d36d8445fa59-etc-tuned\") pod \"tuned-g48n5\" (UID: \"dc2abf53-dbe9-411d-9da0-d36d8445fa59\") " pod="openshift-cluster-node-tuning-operator/tuned-g48n5" Jul 23 22:22:53.837943 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.770072 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dc2abf53-dbe9-411d-9da0-d36d8445fa59-tmp\") pod \"tuned-g48n5\" (UID: \"dc2abf53-dbe9-411d-9da0-d36d8445fa59\") " pod="openshift-cluster-node-tuning-operator/tuned-g48n5" Jul 23 22:22:53.837943 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.770102 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1df4f160-29b0-42fb-a1f5-46b469eec23b-ovn-node-metrics-cert\") pod \"ovnkube-node-hrvdq\" (UID: \"1df4f160-29b0-42fb-a1f5-46b469eec23b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrvdq" Jul 23 22:22:53.837943 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.770231 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/74793765-85c1-4990-8cb0-892552debf77-agent-certs\") pod \"konnectivity-agent-6t59s\" (UID: \"74793765-85c1-4990-8cb0-892552debf77\") " pod="kube-system/konnectivity-agent-6t59s" Jul 23 22:22:53.838399 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.770489 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8mzf\" (UniqueName: \"kubernetes.io/projected/fc3410ae-ba34-41dc-b992-c51a7bd26fd4-kube-api-access-d8mzf\") pod \"network-metrics-daemon-fd6hg\" (UID: \"fc3410ae-ba34-41dc-b992-c51a7bd26fd4\") " pod="openshift-multus/network-metrics-daemon-fd6hg" Jul 23 22:22:53.838399 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.770613 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktmhk\" (UniqueName: \"kubernetes.io/projected/1df4f160-29b0-42fb-a1f5-46b469eec23b-kube-api-access-ktmhk\") pod \"ovnkube-node-hrvdq\" (UID: \"1df4f160-29b0-42fb-a1f5-46b469eec23b\") " pod="openshift-ovn-kubernetes/ovnkube-node-hrvdq" Jul 23 22:22:53.838399 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.775552 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlpzm\" (UniqueName: \"kubernetes.io/projected/6e8b3555-1c33-4b27-8431-caf4c5b1a347-kube-api-access-jlpzm\") pod \"aws-ebs-csi-driver-node-dvvl7\" (UID: \"6e8b3555-1c33-4b27-8431-caf4c5b1a347\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dvvl7" Jul 23 22:22:53.838399 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.779394 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2jjv\" (UniqueName: \"kubernetes.io/projected/f9e1354d-23f7-472b-8486-a9eccb352a8e-kube-api-access-t2jjv\") pod \"iptables-alerter-pkrss\" (UID: \"f9e1354d-23f7-472b-8486-a9eccb352a8e\") " pod="openshift-network-operator/iptables-alerter-pkrss" Jul 23 22:22:53.838399 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.780536 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-65mqs\" (UniqueName: \"kubernetes.io/projected/dc2abf53-dbe9-411d-9da0-d36d8445fa59-kube-api-access-65mqs\") pod \"tuned-g48n5\" (UID: \"dc2abf53-dbe9-411d-9da0-d36d8445fa59\") " pod="openshift-cluster-node-tuning-operator/tuned-g48n5" Jul 23 22:22:53.838399 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.780553 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4h9rg\" (UniqueName: \"kubernetes.io/projected/0dbcc8cc-adc8-472c-976c-f30472ad20b2-kube-api-access-4h9rg\") pod \"multus-additional-cni-plugins-2sdbj\" (UID: \"0dbcc8cc-adc8-472c-976c-f30472ad20b2\") " pod="openshift-multus/multus-additional-cni-plugins-2sdbj" Jul 23 22:22:53.838399 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.780816 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrvg8\" (UniqueName: \"kubernetes.io/projected/e3b1b5a6-36fa-44e7-9a9c-a2e045119f90-kube-api-access-mrvg8\") pod \"node-resolver-qwb6v\" (UID: \"e3b1b5a6-36fa-44e7-9a9c-a2e045119f90\") " pod="openshift-dns/node-resolver-qwb6v" Jul 23 22:22:53.838399 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.781149 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pl5x4\" (UniqueName: \"kubernetes.io/projected/29b80f76-486c-4fbb-a2ec-c66f223803ba-kube-api-access-pl5x4\") pod \"node-ca-9vqwp\" (UID: \"29b80f76-486c-4fbb-a2ec-c66f223803ba\") " pod="openshift-image-registry/node-ca-9vqwp" Jul 23 22:22:53.838399 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.784077 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcmsz\" (UniqueName: \"kubernetes.io/projected/13d4e65e-9e85-4531-a139-0224fac37ac3-kube-api-access-wcmsz\") pod \"multus-q66nz\" (UID: \"13d4e65e-9e85-4531-a139-0224fac37ac3\") " pod="openshift-multus/multus-q66nz" Jul 23 22:22:53.838399 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.803643 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-206.ec2.internal" event={"ID":"0baba1e243f7aa3ffdfefa29d6fc657e","Type":"ContainerStarted","Data":"0e825fbd50a03cbc45a936a6c3b0399f18ad8194085b651cd3c35e4678a102b7"} Jul 23 22:22:53.838399 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.804516 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-206.ec2.internal" event={"ID":"c327b22ac949a2a8daf1ee2904cbe0b1","Type":"ContainerStarted","Data":"22e1173c11980f6275a6f16a99fce5524ad1d16dfb534ecb5b5d2ad9e3a9f37a"} Jul 23 22:22:54.065564 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.868817 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/81890460-aa07-4749-aadd-909c876b9244-original-pull-secret\") pod \"global-pull-secret-syncer-pl657\" (UID: \"81890460-aa07-4749-aadd-909c876b9244\") " pod="kube-system/global-pull-secret-syncer-pl657" Jul 23 22:22:54.065564 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.868839 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/81890460-aa07-4749-aadd-909c876b9244-kubelet-config\") pod \"global-pull-secret-syncer-pl657\" (UID: \"81890460-aa07-4749-aadd-909c876b9244\") " pod="kube-system/global-pull-secret-syncer-pl657" Jul 23 22:22:54.065564 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.868861 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/81890460-aa07-4749-aadd-909c876b9244-dbus\") pod \"global-pull-secret-syncer-pl657\" (UID: \"81890460-aa07-4749-aadd-909c876b9244\") " pod="kube-system/global-pull-secret-syncer-pl657" Jul 23 22:22:54.065564 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.868922 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/81890460-aa07-4749-aadd-909c876b9244-dbus\") pod \"global-pull-secret-syncer-pl657\" (UID: \"81890460-aa07-4749-aadd-909c876b9244\") " pod="kube-system/global-pull-secret-syncer-pl657" Jul 23 22:22:54.065564 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:22:53.868931 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 22:22:54.065564 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.868922 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/81890460-aa07-4749-aadd-909c876b9244-kubelet-config\") pod \"global-pull-secret-syncer-pl657\" (UID: \"81890460-aa07-4749-aadd-909c876b9244\") " pod="kube-system/global-pull-secret-syncer-pl657" Jul 23 22:22:54.065564 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:22:53.868969 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81890460-aa07-4749-aadd-909c876b9244-original-pull-secret podName:81890460-aa07-4749-aadd-909c876b9244 nodeName:}" failed. No retries permitted until 2026-07-23 22:22:54.368959344 +0000 UTC m=+2.088956580 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/81890460-aa07-4749-aadd-909c876b9244-original-pull-secret") pod "global-pull-secret-syncer-pl657" (UID: "81890460-aa07-4749-aadd-909c876b9244") : object "kube-system"/"original-pull-secret" not registered Jul 23 22:22:54.065564 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.917863 2575 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 22:22:54.065564 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.977482 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6t59s" Jul 23 22:22:54.065564 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:53.982773 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dvvl7" Jul 23 22:22:54.065564 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:53.984343 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74793765_85c1_4990_8cb0_892552debf77.slice/crio-1494eb544d8320051568fee20e834589c44b372cc2af30d9d3eb5fc8d9d12a16 WatchSource:0}: Error finding container 1494eb544d8320051568fee20e834589c44b372cc2af30d9d3eb5fc8d9d12a16: Status 404 returned error can't find the container with id 1494eb544d8320051568fee20e834589c44b372cc2af30d9d3eb5fc8d9d12a16 Jul 23 22:22:54.065564 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:53.988801 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e8b3555_1c33_4b27_8431_caf4c5b1a347.slice/crio-cc59d95bed1b7447197a2e4031e1e6d6d8458fcb543c534843fa8ed9e1ea76bc WatchSource:0}: Error finding container cc59d95bed1b7447197a2e4031e1e6d6d8458fcb543c534843fa8ed9e1ea76bc: Status 404 returned error can't find the container with id cc59d95bed1b7447197a2e4031e1e6d6d8458fcb543c534843fa8ed9e1ea76bc Jul 23 22:22:54.065564 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:54.002893 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qwb6v" Jul 23 22:22:54.065564 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:54.008293 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3b1b5a6_36fa_44e7_9a9c_a2e045119f90.slice/crio-77e90bcf3d2cdbb5aa0f667daa5a50f2da4c1fafd4667acd919967287ce52fbf WatchSource:0}: Error finding container 77e90bcf3d2cdbb5aa0f667daa5a50f2da4c1fafd4667acd919967287ce52fbf: Status 404 returned error can't find the container with id 77e90bcf3d2cdbb5aa0f667daa5a50f2da4c1fafd4667acd919967287ce52fbf Jul 23 22:22:54.065564 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:54.021121 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2sdbj" Jul 23 22:22:54.065564 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:54.026878 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hrvdq" Jul 23 22:22:54.067006 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:54.027039 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0dbcc8cc_adc8_472c_976c_f30472ad20b2.slice/crio-59d74bfc7445454e23665f1779d4d95024244e57ac8c18264ebfbd5f3fcfee66 WatchSource:0}: Error finding container 59d74bfc7445454e23665f1779d4d95024244e57ac8c18264ebfbd5f3fcfee66: Status 404 returned error can't find the container with id 59d74bfc7445454e23665f1779d4d95024244e57ac8c18264ebfbd5f3fcfee66 Jul 23 22:22:54.067006 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:54.033255 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-g48n5" Jul 23 22:22:54.067006 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:54.039044 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc2abf53_dbe9_411d_9da0_d36d8445fa59.slice/crio-025e7dc522f3f4cc1ed3806e3caab687cac723084dccf053992f3124b1d5cb38 WatchSource:0}: Error finding container 025e7dc522f3f4cc1ed3806e3caab687cac723084dccf053992f3124b1d5cb38: Status 404 returned error can't find the container with id 025e7dc522f3f4cc1ed3806e3caab687cac723084dccf053992f3124b1d5cb38 Jul 23 22:22:54.067006 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:54.039214 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9vqwp" Jul 23 22:22:54.067006 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:54.045284 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29b80f76_486c_4fbb_a2ec_c66f223803ba.slice/crio-4523657cdd784e2ac9f3510149fe18414acef65015637352871340f6bdcea5e1 WatchSource:0}: Error finding container 4523657cdd784e2ac9f3510149fe18414acef65015637352871340f6bdcea5e1: Status 404 returned error can't find the container with id 4523657cdd784e2ac9f3510149fe18414acef65015637352871340f6bdcea5e1 Jul 23 22:22:54.067006 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:54.047089 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-q66nz" Jul 23 22:22:54.067006 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:54.053550 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13d4e65e_9e85_4531_a139_0224fac37ac3.slice/crio-6ea8be84d5f779c1f80add6718fe3ca313a45a15b2a6e2fc8f1e32c4c5457aad WatchSource:0}: Error finding container 6ea8be84d5f779c1f80add6718fe3ca313a45a15b2a6e2fc8f1e32c4c5457aad: Status 404 returned error can't find the container with id 6ea8be84d5f779c1f80add6718fe3ca313a45a15b2a6e2fc8f1e32c4c5457aad Jul 23 22:22:54.067006 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:54.054714 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pkrss" Jul 23 22:22:54.067006 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:22:54.061623 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9e1354d_23f7_472b_8486_a9eccb352a8e.slice/crio-d6ee60da493a60430fce0490141808936e4d9d8c66f9756e1c286bf715f3088e WatchSource:0}: Error finding container d6ee60da493a60430fce0490141808936e4d9d8c66f9756e1c286bf715f3088e: Status 404 returned error can't find the container with id d6ee60da493a60430fce0490141808936e4d9d8c66f9756e1c286bf715f3088e Jul 23 22:22:54.352062 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:54.270813 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwhn2\" (UniqueName: \"kubernetes.io/projected/2d81f7cf-acbc-4389-b9fb-e621c3c060d4-kube-api-access-hwhn2\") pod \"network-check-target-ks6hk\" (UID: \"2d81f7cf-acbc-4389-b9fb-e621c3c060d4\") " pod="openshift-network-diagnostics/network-check-target-ks6hk" Jul 23 22:22:54.352062 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:54.270878 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc3410ae-ba34-41dc-b992-c51a7bd26fd4-metrics-certs\") pod \"network-metrics-daemon-fd6hg\" (UID: \"fc3410ae-ba34-41dc-b992-c51a7bd26fd4\") " pod="openshift-multus/network-metrics-daemon-fd6hg" Jul 23 22:22:54.352062 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:22:54.271004 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 22:22:54.352062 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:22:54.271010 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 22:22:54.352062 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:22:54.271047 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 22:22:54.352062 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:22:54.271057 2575 projected.go:196] Error preparing data for projected volume kube-api-access-hwhn2 for pod openshift-network-diagnostics/network-check-target-ks6hk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 22:22:54.352062 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:22:54.271068 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc3410ae-ba34-41dc-b992-c51a7bd26fd4-metrics-certs podName:fc3410ae-ba34-41dc-b992-c51a7bd26fd4 nodeName:}" failed. No retries permitted until 2026-07-23 22:22:55.271051221 +0000 UTC m=+2.991048462 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fc3410ae-ba34-41dc-b992-c51a7bd26fd4-metrics-certs") pod "network-metrics-daemon-fd6hg" (UID: "fc3410ae-ba34-41dc-b992-c51a7bd26fd4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 22:22:54.352062 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:22:54.271088 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2d81f7cf-acbc-4389-b9fb-e621c3c060d4-kube-api-access-hwhn2 podName:2d81f7cf-acbc-4389-b9fb-e621c3c060d4 nodeName:}" failed. No retries permitted until 2026-07-23 22:22:55.271078591 +0000 UTC m=+2.991075839 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-hwhn2" (UniqueName: "kubernetes.io/projected/2d81f7cf-acbc-4389-b9fb-e621c3c060d4-kube-api-access-hwhn2") pod "network-check-target-ks6hk" (UID: "2d81f7cf-acbc-4389-b9fb-e621c3c060d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 22:22:54.431790 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:54.371585 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/81890460-aa07-4749-aadd-909c876b9244-original-pull-secret\") pod \"global-pull-secret-syncer-pl657\" (UID: \"81890460-aa07-4749-aadd-909c876b9244\") " pod="kube-system/global-pull-secret-syncer-pl657" Jul 23 22:22:54.431790 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:22:54.371695 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 22:22:54.431790 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:22:54.371741 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81890460-aa07-4749-aadd-909c876b9244-original-pull-secret podName:81890460-aa07-4749-aadd-909c876b9244 nodeName:}" failed. No retries permitted until 2026-07-23 22:22:55.37172618 +0000 UTC m=+3.091723420 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/81890460-aa07-4749-aadd-909c876b9244-original-pull-secret") pod "global-pull-secret-syncer-pl657" (UID: "81890460-aa07-4749-aadd-909c876b9244") : object "kube-system"/"original-pull-secret" not registered Jul 23 22:22:54.692216 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:54.691838 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 22:17:53 +0000 UTC" deadline="2028-04-19 15:05:43.964747872 +0000 UTC" Jul 23 22:22:54.692216 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:54.691888 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15256h42m49.272863218s" Jul 23 22:22:54.829299 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:54.829181 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2sdbj" event={"ID":"0dbcc8cc-adc8-472c-976c-f30472ad20b2","Type":"ContainerStarted","Data":"59d74bfc7445454e23665f1779d4d95024244e57ac8c18264ebfbd5f3fcfee66"} Jul 23 22:22:54.836246 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:54.836220 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6t59s" event={"ID":"74793765-85c1-4990-8cb0-892552debf77","Type":"ContainerStarted","Data":"1494eb544d8320051568fee20e834589c44b372cc2af30d9d3eb5fc8d9d12a16"} Jul 23 22:22:54.837823 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:54.837770 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pkrss" event={"ID":"f9e1354d-23f7-472b-8486-a9eccb352a8e","Type":"ContainerStarted","Data":"d6ee60da493a60430fce0490141808936e4d9d8c66f9756e1c286bf715f3088e"} Jul 23 22:22:54.848062 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:54.847986 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-q66nz" event={"ID":"13d4e65e-9e85-4531-a139-0224fac37ac3","Type":"ContainerStarted","Data":"6ea8be84d5f779c1f80add6718fe3ca313a45a15b2a6e2fc8f1e32c4c5457aad"} Jul 23 22:22:54.871629 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:54.871604 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hrvdq" event={"ID":"1df4f160-29b0-42fb-a1f5-46b469eec23b","Type":"ContainerStarted","Data":"75a0d23fdab36a6b4dbf3b8ca864bd896d230c77bd666f31d57d8b15b4bdc00b"} Jul 23 22:22:54.883621 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:54.883599 2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 22:22:54.886181 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:54.886083 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qwb6v" event={"ID":"e3b1b5a6-36fa-44e7-9a9c-a2e045119f90","Type":"ContainerStarted","Data":"77e90bcf3d2cdbb5aa0f667daa5a50f2da4c1fafd4667acd919967287ce52fbf"} Jul 23 22:22:54.899338 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:54.899315 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dvvl7" event={"ID":"6e8b3555-1c33-4b27-8431-caf4c5b1a347","Type":"ContainerStarted","Data":"cc59d95bed1b7447197a2e4031e1e6d6d8458fcb543c534843fa8ed9e1ea76bc"} Jul 23 22:22:54.906719 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:54.906696 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9vqwp" event={"ID":"29b80f76-486c-4fbb-a2ec-c66f223803ba","Type":"ContainerStarted","Data":"4523657cdd784e2ac9f3510149fe18414acef65015637352871340f6bdcea5e1"} Jul 23 22:22:54.913852 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:54.913794 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-g48n5" event={"ID":"dc2abf53-dbe9-411d-9da0-d36d8445fa59","Type":"ContainerStarted","Data":"025e7dc522f3f4cc1ed3806e3caab687cac723084dccf053992f3124b1d5cb38"} Jul 23 22:22:54.936002 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:54.935832 2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 22:22:55.280252 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:55.279340 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwhn2\" (UniqueName: \"kubernetes.io/projected/2d81f7cf-acbc-4389-b9fb-e621c3c060d4-kube-api-access-hwhn2\") pod \"network-check-target-ks6hk\" (UID: \"2d81f7cf-acbc-4389-b9fb-e621c3c060d4\") " pod="openshift-network-diagnostics/network-check-target-ks6hk" Jul 23 22:22:55.280252 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:55.279412 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc3410ae-ba34-41dc-b992-c51a7bd26fd4-metrics-certs\") pod \"network-metrics-daemon-fd6hg\" (UID: \"fc3410ae-ba34-41dc-b992-c51a7bd26fd4\") " pod="openshift-multus/network-metrics-daemon-fd6hg" Jul 23 22:22:55.280252 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:22:55.279543 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 22:22:55.280252 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:22:55.279597 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc3410ae-ba34-41dc-b992-c51a7bd26fd4-metrics-certs podName:fc3410ae-ba34-41dc-b992-c51a7bd26fd4 nodeName:}" failed. No retries permitted until 2026-07-23 22:22:57.279580094 +0000 UTC m=+4.999577331 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fc3410ae-ba34-41dc-b992-c51a7bd26fd4-metrics-certs") pod "network-metrics-daemon-fd6hg" (UID: "fc3410ae-ba34-41dc-b992-c51a7bd26fd4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 22:22:55.280252 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:22:55.280148 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 22:22:55.280252 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:22:55.280166 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 22:22:55.280252 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:22:55.280177 2575 projected.go:196] Error preparing data for projected volume kube-api-access-hwhn2 for pod openshift-network-diagnostics/network-check-target-ks6hk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 22:22:55.280252 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:22:55.280219 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2d81f7cf-acbc-4389-b9fb-e621c3c060d4-kube-api-access-hwhn2 podName:2d81f7cf-acbc-4389-b9fb-e621c3c060d4 nodeName:}" failed. No retries permitted until 2026-07-23 22:22:57.280204782 +0000 UTC m=+5.000202031 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-hwhn2" (UniqueName: "kubernetes.io/projected/2d81f7cf-acbc-4389-b9fb-e621c3c060d4-kube-api-access-hwhn2") pod "network-check-target-ks6hk" (UID: "2d81f7cf-acbc-4389-b9fb-e621c3c060d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 22:22:55.381054 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:55.380564 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/81890460-aa07-4749-aadd-909c876b9244-original-pull-secret\") pod \"global-pull-secret-syncer-pl657\" (UID: \"81890460-aa07-4749-aadd-909c876b9244\") " pod="kube-system/global-pull-secret-syncer-pl657" Jul 23 22:22:55.381054 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:22:55.380680 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 22:22:55.381054 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:22:55.380728 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81890460-aa07-4749-aadd-909c876b9244-original-pull-secret podName:81890460-aa07-4749-aadd-909c876b9244 nodeName:}" failed. No retries permitted until 2026-07-23 22:22:57.38071284 +0000 UTC m=+5.100710081 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/81890460-aa07-4749-aadd-909c876b9244-original-pull-secret") pod "global-pull-secret-syncer-pl657" (UID: "81890460-aa07-4749-aadd-909c876b9244") : object "kube-system"/"original-pull-secret" not registered Jul 23 22:22:55.693390 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:55.693292 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 22:17:53 +0000 UTC" deadline="2028-01-25 06:26:56.605132503 +0000 UTC" Jul 23 22:22:55.693390 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:55.693347 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13208h4m0.911789365s" Jul 23 22:22:55.802413 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:55.801646 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pl657" Jul 23 22:22:55.802413 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:22:55.801757 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pl657" podUID="81890460-aa07-4749-aadd-909c876b9244" Jul 23 22:22:55.802413 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:55.802138 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fd6hg" Jul 23 22:22:55.802413 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:22:55.802229 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fd6hg" podUID="fc3410ae-ba34-41dc-b992-c51a7bd26fd4" Jul 23 22:22:55.802413 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:55.802283 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ks6hk" Jul 23 22:22:55.802413 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:22:55.802346 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ks6hk" podUID="2d81f7cf-acbc-4389-b9fb-e621c3c060d4" Jul 23 22:22:57.295341 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:57.294717 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc3410ae-ba34-41dc-b992-c51a7bd26fd4-metrics-certs\") pod \"network-metrics-daemon-fd6hg\" (UID: \"fc3410ae-ba34-41dc-b992-c51a7bd26fd4\") " pod="openshift-multus/network-metrics-daemon-fd6hg" Jul 23 22:22:57.295341 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:57.294768 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwhn2\" (UniqueName: \"kubernetes.io/projected/2d81f7cf-acbc-4389-b9fb-e621c3c060d4-kube-api-access-hwhn2\") pod \"network-check-target-ks6hk\" (UID: \"2d81f7cf-acbc-4389-b9fb-e621c3c060d4\") " pod="openshift-network-diagnostics/network-check-target-ks6hk" Jul 23 22:22:57.295341 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:22:57.294888 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 22:22:57.295341 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:22:57.294903 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 22:22:57.295341 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:22:57.294911 2575 projected.go:196] Error preparing data for projected volume kube-api-access-hwhn2 for pod openshift-network-diagnostics/network-check-target-ks6hk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 22:22:57.295341 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:22:57.294952 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2d81f7cf-acbc-4389-b9fb-e621c3c060d4-kube-api-access-hwhn2 podName:2d81f7cf-acbc-4389-b9fb-e621c3c060d4 nodeName:}" failed. No retries permitted until 2026-07-23 22:23:01.294937134 +0000 UTC m=+9.014934375 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-hwhn2" (UniqueName: "kubernetes.io/projected/2d81f7cf-acbc-4389-b9fb-e621c3c060d4-kube-api-access-hwhn2") pod "network-check-target-ks6hk" (UID: "2d81f7cf-acbc-4389-b9fb-e621c3c060d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 22:22:57.295341 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:22:57.295005 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 22:22:57.295341 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:22:57.295050 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc3410ae-ba34-41dc-b992-c51a7bd26fd4-metrics-certs podName:fc3410ae-ba34-41dc-b992-c51a7bd26fd4 nodeName:}" failed. No retries permitted until 2026-07-23 22:23:01.295038386 +0000 UTC m=+9.015035629 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fc3410ae-ba34-41dc-b992-c51a7bd26fd4-metrics-certs") pod "network-metrics-daemon-fd6hg" (UID: "fc3410ae-ba34-41dc-b992-c51a7bd26fd4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 22:22:57.395679 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:57.395647 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/81890460-aa07-4749-aadd-909c876b9244-original-pull-secret\") pod \"global-pull-secret-syncer-pl657\" (UID: \"81890460-aa07-4749-aadd-909c876b9244\") " pod="kube-system/global-pull-secret-syncer-pl657" Jul 23 22:22:57.395814 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:22:57.395748 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 22:22:57.395880 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:22:57.395816 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81890460-aa07-4749-aadd-909c876b9244-original-pull-secret podName:81890460-aa07-4749-aadd-909c876b9244 nodeName:}" failed. No retries permitted until 2026-07-23 22:23:01.395797777 +0000 UTC m=+9.115795029 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/81890460-aa07-4749-aadd-909c876b9244-original-pull-secret") pod "global-pull-secret-syncer-pl657" (UID: "81890460-aa07-4749-aadd-909c876b9244") : object "kube-system"/"original-pull-secret" not registered Jul 23 22:22:57.801673 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:57.801646 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ks6hk" Jul 23 22:22:57.801821 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:22:57.801764 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ks6hk" podUID="2d81f7cf-acbc-4389-b9fb-e621c3c060d4" Jul 23 22:22:57.802070 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:57.802050 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fd6hg" Jul 23 22:22:57.802140 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:57.802069 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pl657" Jul 23 22:22:57.802197 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:22:57.802163 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fd6hg" podUID="fc3410ae-ba34-41dc-b992-c51a7bd26fd4" Jul 23 22:22:57.802277 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:22:57.802251 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pl657" podUID="81890460-aa07-4749-aadd-909c876b9244" Jul 23 22:22:59.802359 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:59.801527 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ks6hk" Jul 23 22:22:59.802359 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:22:59.801644 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ks6hk" podUID="2d81f7cf-acbc-4389-b9fb-e621c3c060d4" Jul 23 22:22:59.802359 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:59.802063 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pl657" Jul 23 22:22:59.802359 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:22:59.802166 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pl657" podUID="81890460-aa07-4749-aadd-909c876b9244" Jul 23 22:22:59.802359 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:22:59.802239 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fd6hg" Jul 23 22:22:59.802359 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:22:59.802324 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fd6hg" podUID="fc3410ae-ba34-41dc-b992-c51a7bd26fd4" Jul 23 22:23:01.327595 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:01.327559 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwhn2\" (UniqueName: \"kubernetes.io/projected/2d81f7cf-acbc-4389-b9fb-e621c3c060d4-kube-api-access-hwhn2\") pod \"network-check-target-ks6hk\" (UID: \"2d81f7cf-acbc-4389-b9fb-e621c3c060d4\") " pod="openshift-network-diagnostics/network-check-target-ks6hk" Jul 23 22:23:01.327999 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:01.327632 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc3410ae-ba34-41dc-b992-c51a7bd26fd4-metrics-certs\") pod \"network-metrics-daemon-fd6hg\" (UID: \"fc3410ae-ba34-41dc-b992-c51a7bd26fd4\") " pod="openshift-multus/network-metrics-daemon-fd6hg" Jul 23 22:23:01.327999 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:01.327700 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 22:23:01.327999 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:01.327729 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 22:23:01.327999 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:01.327743 2575 projected.go:196] Error preparing data for projected volume kube-api-access-hwhn2 for pod openshift-network-diagnostics/network-check-target-ks6hk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 22:23:01.327999 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:01.327744 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 22:23:01.327999 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:01.327801 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2d81f7cf-acbc-4389-b9fb-e621c3c060d4-kube-api-access-hwhn2 podName:2d81f7cf-acbc-4389-b9fb-e621c3c060d4 nodeName:}" failed. No retries permitted until 2026-07-23 22:23:09.327782317 +0000 UTC m=+17.047779557 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-hwhn2" (UniqueName: "kubernetes.io/projected/2d81f7cf-acbc-4389-b9fb-e621c3c060d4-kube-api-access-hwhn2") pod "network-check-target-ks6hk" (UID: "2d81f7cf-acbc-4389-b9fb-e621c3c060d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 22:23:01.327999 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:01.327822 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc3410ae-ba34-41dc-b992-c51a7bd26fd4-metrics-certs podName:fc3410ae-ba34-41dc-b992-c51a7bd26fd4 nodeName:}" failed. No retries permitted until 2026-07-23 22:23:09.327811897 +0000 UTC m=+17.047809140 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fc3410ae-ba34-41dc-b992-c51a7bd26fd4-metrics-certs") pod "network-metrics-daemon-fd6hg" (UID: "fc3410ae-ba34-41dc-b992-c51a7bd26fd4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 22:23:01.428763 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:01.428695 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/81890460-aa07-4749-aadd-909c876b9244-original-pull-secret\") pod \"global-pull-secret-syncer-pl657\" (UID: \"81890460-aa07-4749-aadd-909c876b9244\") " pod="kube-system/global-pull-secret-syncer-pl657" Jul 23 22:23:01.428919 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:01.428837 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 22:23:01.428919 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:01.428901 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81890460-aa07-4749-aadd-909c876b9244-original-pull-secret podName:81890460-aa07-4749-aadd-909c876b9244 nodeName:}" failed. No retries permitted until 2026-07-23 22:23:09.42888362 +0000 UTC m=+17.148880872 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/81890460-aa07-4749-aadd-909c876b9244-original-pull-secret") pod "global-pull-secret-syncer-pl657" (UID: "81890460-aa07-4749-aadd-909c876b9244") : object "kube-system"/"original-pull-secret" not registered Jul 23 22:23:01.802339 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:01.802265 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pl657" Jul 23 22:23:01.802339 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:01.802303 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fd6hg" Jul 23 22:23:01.802567 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:01.802270 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ks6hk" Jul 23 22:23:01.802567 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:01.802441 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fd6hg" podUID="fc3410ae-ba34-41dc-b992-c51a7bd26fd4" Jul 23 22:23:01.802567 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:01.802441 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pl657" podUID="81890460-aa07-4749-aadd-909c876b9244" Jul 23 22:23:01.802567 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:01.802509 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ks6hk" podUID="2d81f7cf-acbc-4389-b9fb-e621c3c060d4" Jul 23 22:23:03.801805 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:03.801773 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ks6hk" Jul 23 22:23:03.802187 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:03.801813 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fd6hg" Jul 23 22:23:03.802187 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:03.801790 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pl657" Jul 23 22:23:03.802187 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:03.801873 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ks6hk" podUID="2d81f7cf-acbc-4389-b9fb-e621c3c060d4" Jul 23 22:23:03.802187 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:03.801942 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pl657" podUID="81890460-aa07-4749-aadd-909c876b9244" Jul 23 22:23:03.802187 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:03.802036 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fd6hg" podUID="fc3410ae-ba34-41dc-b992-c51a7bd26fd4" Jul 23 22:23:05.801583 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:05.801553 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pl657" Jul 23 22:23:05.801987 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:05.801668 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ks6hk" Jul 23 22:23:05.801987 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:05.801673 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pl657" podUID="81890460-aa07-4749-aadd-909c876b9244" Jul 23 22:23:05.801987 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:05.801783 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ks6hk" podUID="2d81f7cf-acbc-4389-b9fb-e621c3c060d4" Jul 23 22:23:05.801987 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:05.801672 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fd6hg" Jul 23 22:23:05.801987 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:05.801924 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fd6hg" podUID="fc3410ae-ba34-41dc-b992-c51a7bd26fd4" Jul 23 22:23:07.801505 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:07.801471 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ks6hk" Jul 23 22:23:07.801925 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:07.801571 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pl657" Jul 23 22:23:07.801925 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:07.801586 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ks6hk" podUID="2d81f7cf-acbc-4389-b9fb-e621c3c060d4" Jul 23 22:23:07.801925 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:07.801648 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pl657" podUID="81890460-aa07-4749-aadd-909c876b9244" Jul 23 22:23:07.801925 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:07.801708 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fd6hg" Jul 23 22:23:07.801925 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:07.801770 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fd6hg" podUID="fc3410ae-ba34-41dc-b992-c51a7bd26fd4" Jul 23 22:23:09.389402 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:09.389371 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwhn2\" (UniqueName: \"kubernetes.io/projected/2d81f7cf-acbc-4389-b9fb-e621c3c060d4-kube-api-access-hwhn2\") pod \"network-check-target-ks6hk\" (UID: \"2d81f7cf-acbc-4389-b9fb-e621c3c060d4\") " pod="openshift-network-diagnostics/network-check-target-ks6hk" Jul 23 22:23:09.389816 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:09.389467 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc3410ae-ba34-41dc-b992-c51a7bd26fd4-metrics-certs\") pod \"network-metrics-daemon-fd6hg\" (UID: \"fc3410ae-ba34-41dc-b992-c51a7bd26fd4\") " pod="openshift-multus/network-metrics-daemon-fd6hg" Jul 23 22:23:09.389816 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:09.389545 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 22:23:09.389816 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:09.389546 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 22:23:09.389960 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:09.389867 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc3410ae-ba34-41dc-b992-c51a7bd26fd4-metrics-certs podName:fc3410ae-ba34-41dc-b992-c51a7bd26fd4 nodeName:}" failed. No retries permitted until 2026-07-23 22:23:25.389580354 +0000 UTC m=+33.109577596 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fc3410ae-ba34-41dc-b992-c51a7bd26fd4-metrics-certs") pod "network-metrics-daemon-fd6hg" (UID: "fc3410ae-ba34-41dc-b992-c51a7bd26fd4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 22:23:09.389960 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:09.389940 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 22:23:09.390068 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:09.389963 2575 projected.go:196] Error preparing data for projected volume kube-api-access-hwhn2 for pod openshift-network-diagnostics/network-check-target-ks6hk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 22:23:09.390068 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:09.390043 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2d81f7cf-acbc-4389-b9fb-e621c3c060d4-kube-api-access-hwhn2 podName:2d81f7cf-acbc-4389-b9fb-e621c3c060d4 nodeName:}" failed. No retries permitted until 2026-07-23 22:23:25.390013198 +0000 UTC m=+33.110010449 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-hwhn2" (UniqueName: "kubernetes.io/projected/2d81f7cf-acbc-4389-b9fb-e621c3c060d4-kube-api-access-hwhn2") pod "network-check-target-ks6hk" (UID: "2d81f7cf-acbc-4389-b9fb-e621c3c060d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 22:23:09.490655 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:09.490624 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/81890460-aa07-4749-aadd-909c876b9244-original-pull-secret\") pod \"global-pull-secret-syncer-pl657\" (UID: \"81890460-aa07-4749-aadd-909c876b9244\") " pod="kube-system/global-pull-secret-syncer-pl657" Jul 23 22:23:09.490798 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:09.490774 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 22:23:09.490878 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:09.490865 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81890460-aa07-4749-aadd-909c876b9244-original-pull-secret podName:81890460-aa07-4749-aadd-909c876b9244 nodeName:}" failed. No retries permitted until 2026-07-23 22:23:25.490848991 +0000 UTC m=+33.210846246 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/81890460-aa07-4749-aadd-909c876b9244-original-pull-secret") pod "global-pull-secret-syncer-pl657" (UID: "81890460-aa07-4749-aadd-909c876b9244") : object "kube-system"/"original-pull-secret" not registered Jul 23 22:23:09.802146 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:09.802116 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pl657" Jul 23 22:23:09.802289 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:09.802225 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fd6hg" Jul 23 22:23:09.802289 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:09.802238 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pl657" podUID="81890460-aa07-4749-aadd-909c876b9244" Jul 23 22:23:09.802289 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:09.802251 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ks6hk" Jul 23 22:23:09.802451 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:09.802322 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fd6hg" podUID="fc3410ae-ba34-41dc-b992-c51a7bd26fd4" Jul 23 22:23:09.802451 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:09.802418 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ks6hk" podUID="2d81f7cf-acbc-4389-b9fb-e621c3c060d4" Jul 23 22:23:11.801860 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:11.801829 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ks6hk" Jul 23 22:23:11.802281 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:11.801829 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pl657" Jul 23 22:23:11.802281 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:11.801933 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ks6hk" podUID="2d81f7cf-acbc-4389-b9fb-e621c3c060d4" Jul 23 22:23:11.802281 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:11.801829 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fd6hg" Jul 23 22:23:11.802281 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:11.802045 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pl657" podUID="81890460-aa07-4749-aadd-909c876b9244" Jul 23 22:23:11.802281 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:11.802152 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fd6hg" podUID="fc3410ae-ba34-41dc-b992-c51a7bd26fd4" Jul 23 22:23:13.801688 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:13.801399 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fd6hg" Jul 23 22:23:13.802278 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:13.801407 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ks6hk" Jul 23 22:23:13.802278 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:13.801767 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fd6hg" podUID="fc3410ae-ba34-41dc-b992-c51a7bd26fd4" Jul 23 22:23:13.802278 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:13.801406 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pl657" Jul 23 22:23:13.802278 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:13.801833 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ks6hk" podUID="2d81f7cf-acbc-4389-b9fb-e621c3c060d4" Jul 23 22:23:13.802278 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:13.801935 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pl657" podUID="81890460-aa07-4749-aadd-909c876b9244" Jul 23 22:23:13.953861 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:13.953833 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6t59s" event={"ID":"74793765-85c1-4990-8cb0-892552debf77","Type":"ContainerStarted","Data":"bee7f6a53c3a37ca66d3bab2d69244db1ad9427756b53ce689ba5f5afdf8ca00"} Jul 23 22:23:13.955245 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:13.955217 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-206.ec2.internal" event={"ID":"c327b22ac949a2a8daf1ee2904cbe0b1","Type":"ContainerStarted","Data":"899243b73985c1f896af2b13f1333936cf331338bb9e9efcfbb69aaca83c6c36"} Jul 23 22:23:13.956801 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:13.956772 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-q66nz" event={"ID":"13d4e65e-9e85-4531-a139-0224fac37ac3","Type":"ContainerStarted","Data":"129e91aaacf6d2632c90ef7933932f1ead19ab74cb2476f7c89a6d290bd85e95"} Jul 23 22:23:13.961246 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:13.961220 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hrvdq" event={"ID":"1df4f160-29b0-42fb-a1f5-46b469eec23b","Type":"ContainerStarted","Data":"c9139c76c28344a6032361b1c370a4a14d1c0c0ff7d6f33e9ec620a54815ce7b"} Jul 23 22:23:13.961334 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:13.961293 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hrvdq" event={"ID":"1df4f160-29b0-42fb-a1f5-46b469eec23b","Type":"ContainerStarted","Data":"ed4756e7e06d67dc7b16e6f2034875e0792e44f62d54a8c34f22969e7cf7e332"} Jul 23 22:23:13.961390 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:13.961345 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hrvdq" event={"ID":"1df4f160-29b0-42fb-a1f5-46b469eec23b","Type":"ContainerStarted","Data":"d3bfb46f6078d52a760c4122e52f9b5b0568f8439bef836978fa3cab08204c4a"} Jul 23 22:23:13.961436 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:13.961394 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hrvdq" event={"ID":"1df4f160-29b0-42fb-a1f5-46b469eec23b","Type":"ContainerStarted","Data":"02afd0c12da051ff8b383aea3db85311e19baa6813958552882d57b3f3d7acc2"} Jul 23 22:23:13.961502 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:13.961435 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hrvdq" event={"ID":"1df4f160-29b0-42fb-a1f5-46b469eec23b","Type":"ContainerStarted","Data":"28f3119261d92c0fede507629c4cf5127851e116699c42a16cd00792a0225a77"} Jul 23 22:23:13.961502 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:13.961476 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hrvdq" event={"ID":"1df4f160-29b0-42fb-a1f5-46b469eec23b","Type":"ContainerStarted","Data":"d0126dffda978d5b4b925ff21fd0c0b74f3c824e4b2656706a8dcd5cb2980248"} Jul 23 22:23:13.962652 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:13.962628 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qwb6v" event={"ID":"e3b1b5a6-36fa-44e7-9a9c-a2e045119f90","Type":"ContainerStarted","Data":"f0ab3ea62733c1ab47d4521139543df2a7ca31218a43baab802adfb7e3511aae"} Jul 23 22:23:13.963920 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:13.963903 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dvvl7" event={"ID":"6e8b3555-1c33-4b27-8431-caf4c5b1a347","Type":"ContainerStarted","Data":"25bb18a2acc252699448c8476498f5258dcd6865559b6a90e754ce5b75013f28"} Jul 23 22:23:13.965341 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:13.965311 2575 generic.go:356] "Generic (PLEG): container finished" podID="0baba1e243f7aa3ffdfefa29d6fc657e" containerID="c5823c4a6457542b0d43670c59b8e6d5bd53c62886682ac272aa42556e4b8fbb" exitCode=0 Jul 23 22:23:13.965415 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:13.965373 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-206.ec2.internal" event={"ID":"0baba1e243f7aa3ffdfefa29d6fc657e","Type":"ContainerDied","Data":"c5823c4a6457542b0d43670c59b8e6d5bd53c62886682ac272aa42556e4b8fbb"} Jul 23 22:23:13.966756 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:13.966733 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9vqwp" event={"ID":"29b80f76-486c-4fbb-a2ec-c66f223803ba","Type":"ContainerStarted","Data":"cdfe520520fd4f955bebe9b9bb334c4015f4ae4f7d81608e27b55b1538c97632"} Jul 23 22:23:13.968200 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:13.968175 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-g48n5" event={"ID":"dc2abf53-dbe9-411d-9da0-d36d8445fa59","Type":"ContainerStarted","Data":"21da5fdae99d9b83aae48cd357bce7a1df963070dcfb5acc526465e131a4e74c"} Jul 23 22:23:13.969759 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:13.969737 2575 generic.go:356] "Generic (PLEG): container finished" podID="0dbcc8cc-adc8-472c-976c-f30472ad20b2" containerID="96164ac23e746d4b0859eb74c1286428747901c356a3f0dfdf41c5b058c1cd49" exitCode=0 Jul 23 22:23:13.969845 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:13.969765 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2sdbj" event={"ID":"0dbcc8cc-adc8-472c-976c-f30472ad20b2","Type":"ContainerDied","Data":"96164ac23e746d4b0859eb74c1286428747901c356a3f0dfdf41c5b058c1cd49"} Jul 23 22:23:13.971846 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:13.971810 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-6t59s" podStartSLOduration=2.824278263 podStartE2EDuration="21.971799176s" totalImagesPullingTime="19.147520913s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 22:22:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:23:13.971562213 +0000 UTC m=+21.691559472" watchObservedRunningTime="2026-07-23 22:23:13.971799176 +0000 UTC m=+21.691796436" Jul 23 22:23:13.991883 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:13.991842 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-g48n5" podStartSLOduration=2.898250446 podStartE2EDuration="21.991831023s" totalImagesPullingTime="19.093580577s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 22:22:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:23:13.991348837 +0000 UTC m=+21.711346097" watchObservedRunningTime="2026-07-23 22:23:13.991831023 +0000 UTC m=+21.711828281" Jul 23 22:23:14.026617 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:14.026582 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-9vqwp" podStartSLOduration=2.943258927 podStartE2EDuration="22.026569287s" totalImagesPullingTime="19.08331036s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 22:22:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:23:14.007785933 +0000 UTC m=+21.727783190" watchObservedRunningTime="2026-07-23 22:23:14.026569287 +0000 UTC m=+21.746566547" Jul 23 22:23:14.026825 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:14.026791 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-q66nz" podStartSLOduration=2.746990534 podStartE2EDuration="22.026779283s" totalImagesPullingTime="19.279788749s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 22:22:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:23:14.026540916 +0000 UTC m=+21.746538199" watchObservedRunningTime="2026-07-23 22:23:14.026779283 +0000 UTC m=+21.746776544" Jul 23 22:23:14.041846 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:14.041805 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-206.ec2.internal" podStartSLOduration=21.041793865 podStartE2EDuration="21.041793865s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 22:22:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:23:14.041297451 +0000 UTC m=+21.761294724" watchObservedRunningTime="2026-07-23 22:23:14.041793865 +0000 UTC m=+21.761791125" Jul 23 22:23:14.057868 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:14.057839 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-qwb6v" podStartSLOduration=2.936810135 podStartE2EDuration="22.057829208s" totalImagesPullingTime="19.121019073s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 22:22:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:23:14.05771676 +0000 UTC m=+21.777714042" watchObservedRunningTime="2026-07-23 22:23:14.057829208 +0000 UTC m=+21.777826468" Jul 23 22:23:14.106035 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:14.105993 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:14.183195 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:14.183141 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:14.261613 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:14.261588 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:14.402519 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:14.402499 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:14.507042 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:14.506960 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:14.913935 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:14.913903 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:14.973978 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:14.973764 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pkrss" event={"ID":"f9e1354d-23f7-472b-8486-a9eccb352a8e","Type":"ContainerStarted","Data":"5fef3d28d23675574b1dc2d2cdbeb8db66e672027140a8aa96b58c16692bf7db"} Jul 23 22:23:14.990252 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:14.990210 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-pkrss" podStartSLOduration=3.922047105 podStartE2EDuration="22.99019149s" totalImagesPullingTime="19.068144385s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 22:22:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:23:14.989285078 +0000 UTC m=+22.709282360" watchObservedRunningTime="2026-07-23 22:23:14.99019149 +0000 UTC m=+22.710188753" Jul 23 22:23:14.994362 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:14.994339 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:15.036625 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:15.036592 2575 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 23 22:23:15.715229 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:15.715192 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:15.725672 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:15.725581 2575 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-23T22:23:15.036609556Z","UUID":"2b75d41e-0eda-4667-9c08-ff966befcf72","Handler":null,"Name":"","Endpoint":""} Jul 23 22:23:15.727405 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:15.727381 2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 23 22:23:15.727522 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:15.727426 2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 23 22:23:15.802378 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:15.802326 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pl657" Jul 23 22:23:15.802654 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:15.802423 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pl657" podUID="81890460-aa07-4749-aadd-909c876b9244" Jul 23 22:23:15.802654 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:15.802326 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ks6hk" Jul 23 22:23:15.802654 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:15.802483 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fd6hg" Jul 23 22:23:15.802654 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:15.802573 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ks6hk" podUID="2d81f7cf-acbc-4389-b9fb-e621c3c060d4" Jul 23 22:23:15.802875 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:15.802662 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fd6hg" podUID="fc3410ae-ba34-41dc-b992-c51a7bd26fd4" Jul 23 22:23:15.818705 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:15.818666 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:15.978557 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:15.978482 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-206.ec2.internal" event={"ID":"0baba1e243f7aa3ffdfefa29d6fc657e","Type":"ContainerStarted","Data":"d96fcabcdd303511dd526a50fd8b454418b57cefee153f05c62d040cd095c7f3"} Jul 23 22:23:15.980906 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:15.980867 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dvvl7" event={"ID":"6e8b3555-1c33-4b27-8431-caf4c5b1a347","Type":"ContainerStarted","Data":"230dcf227c0f1d45afcbde4a8872e9af8105c289e7eebe942e9bbec451e6424e"} Jul 23 22:23:15.994362 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:15.994311 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-206.ec2.internal" podStartSLOduration=22.994292035 podStartE2EDuration="22.994292035s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 22:22:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:23:15.994138977 +0000 UTC m=+23.714136238" watchObservedRunningTime="2026-07-23 22:23:15.994292035 +0000 UTC m=+23.714289294" Jul 23 22:23:16.097187 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:16.097152 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:16.185750 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:16.185712 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:16.482567 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:16.482482 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:16.542719 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:16.542694 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:16.860621 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:16.860533 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:16.980925 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:16.980876 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:16.986254 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:16.986224 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hrvdq" event={"ID":"1df4f160-29b0-42fb-a1f5-46b469eec23b","Type":"ContainerStarted","Data":"ef49e0c9a8adb9308f2f3710b45ebfecfd58a883440498252ae6b40942c6c3f2"} Jul 23 22:23:17.156513 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:17.156421 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:17.246315 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:17.246290 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qwb6v_e3b1b5a6-36fa-44e7-9a9c-a2e045119f90/dns-node-resolver/0.log" Jul 23 22:23:17.263144 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:17.263121 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:17.342430 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:17.342404 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:17.618182 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:17.618144 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-6t59s" Jul 23 22:23:17.619210 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:17.619187 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-6t59s" Jul 23 22:23:17.802369 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:17.802303 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ks6hk" Jul 23 22:23:17.802369 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:17.802326 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pl657" Jul 23 22:23:17.802594 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:17.802427 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ks6hk" podUID="2d81f7cf-acbc-4389-b9fb-e621c3c060d4" Jul 23 22:23:17.802594 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:17.802436 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fd6hg" Jul 23 22:23:17.802594 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:17.802515 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pl657" podUID="81890460-aa07-4749-aadd-909c876b9244" Jul 23 22:23:17.802705 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:17.802603 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fd6hg" podUID="fc3410ae-ba34-41dc-b992-c51a7bd26fd4" Jul 23 22:23:17.990749 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:17.990652 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-6t59s" Jul 23 22:23:17.991125 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:17.991108 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-6t59s" Jul 23 22:23:18.056219 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:18.056162 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:18.242510 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:18.242453 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9vqwp_29b80f76-486c-4fbb-a2ec-c66f223803ba/node-ca/0.log" Jul 23 22:23:18.765391 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:18.765260 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:18.991874 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:18.991847 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dvvl7" event={"ID":"6e8b3555-1c33-4b27-8431-caf4c5b1a347","Type":"ContainerStarted","Data":"f21cee20a7f8642781fd62a68f2efe516aa47869d646a6163a7e978aa48f2d95"} Jul 23 22:23:18.993518 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:18.993495 2575 generic.go:356] "Generic (PLEG): container finished" podID="0dbcc8cc-adc8-472c-976c-f30472ad20b2" containerID="5f27abb535bf968c4a4e566fb05e4c12e238c406f22b67a59e379932d6091019" exitCode=0 Jul 23 22:23:18.993636 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:18.993571 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2sdbj" event={"ID":"0dbcc8cc-adc8-472c-976c-f30472ad20b2","Type":"ContainerDied","Data":"5f27abb535bf968c4a4e566fb05e4c12e238c406f22b67a59e379932d6091019"} Jul 23 22:23:18.997377 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:18.997359 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hrvdq" event={"ID":"1df4f160-29b0-42fb-a1f5-46b469eec23b","Type":"ContainerStarted","Data":"cd3af48601fc64e553382244a4944c23b84328fee695dca60beef3971024f89f"} Jul 23 22:23:18.997563 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:18.997542 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hrvdq" Jul 23 22:23:19.012369 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:19.012353 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hrvdq" Jul 23 22:23:19.013062 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:19.013012 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dvvl7" podStartSLOduration=3.687117809 podStartE2EDuration="27.012999322s" totalImagesPullingTime="23.325881513s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 22:22:52 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:23:19.01249277 +0000 UTC m=+26.732490032" watchObservedRunningTime="2026-07-23 22:23:19.012999322 +0000 UTC m=+26.732996582" Jul 23 22:23:19.038674 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:19.038617 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-hrvdq" podStartSLOduration=7.9002224739999996 podStartE2EDuration="27.038605713s" totalImagesPullingTime="19.138383239s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 22:22:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:23:19.038252958 +0000 UTC m=+26.758250239" watchObservedRunningTime="2026-07-23 22:23:19.038605713 +0000 UTC m=+26.758602972" Jul 23 22:23:19.717682 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:19.717651 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:19.801453 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:19.801414 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ks6hk" Jul 23 22:23:19.801595 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:19.801493 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pl657" Jul 23 22:23:19.801632 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:19.801602 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fd6hg" Jul 23 22:23:19.801663 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:19.801628 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ks6hk" podUID="2d81f7cf-acbc-4389-b9fb-e621c3c060d4" Jul 23 22:23:19.801758 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:19.801735 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fd6hg" podUID="fc3410ae-ba34-41dc-b992-c51a7bd26fd4" Jul 23 22:23:19.801826 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:19.801812 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pl657" podUID="81890460-aa07-4749-aadd-909c876b9244" Jul 23 22:23:19.999227 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:19.999149 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hrvdq" Jul 23 22:23:19.999768 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:19.999667 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hrvdq" Jul 23 22:23:20.013014 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:20.012995 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hrvdq" Jul 23 22:23:20.336624 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:20.336529 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ks6hk"] Jul 23 22:23:20.336754 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:20.336641 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ks6hk" Jul 23 22:23:20.336819 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:20.336743 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ks6hk" podUID="2d81f7cf-acbc-4389-b9fb-e621c3c060d4" Jul 23 22:23:20.342739 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:20.342714 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-pl657"] Jul 23 22:23:20.342883 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:20.342797 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pl657" Jul 23 22:23:20.342964 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:20.342900 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pl657" podUID="81890460-aa07-4749-aadd-909c876b9244" Jul 23 22:23:20.343275 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:20.343256 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fd6hg"] Jul 23 22:23:20.343365 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:20.343338 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fd6hg" Jul 23 22:23:20.343452 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:20.343432 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fd6hg" podUID="fc3410ae-ba34-41dc-b992-c51a7bd26fd4" Jul 23 22:23:20.399877 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:20.399844 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:20.689044 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:20.689011 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:20.772614 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:20.772596 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:20.884091 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:20.884064 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:20.992277 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:20.992207 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:21.002524 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:21.002503 2575 generic.go:356] "Generic (PLEG): container finished" podID="0dbcc8cc-adc8-472c-976c-f30472ad20b2" containerID="d3a3fbbf47c464aa1a6013276d164da0413ed2352779df27dc3dd48f473366c2" exitCode=0 Jul 23 22:23:21.002860 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:21.002584 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2sdbj" event={"ID":"0dbcc8cc-adc8-472c-976c-f30472ad20b2","Type":"ContainerDied","Data":"d3a3fbbf47c464aa1a6013276d164da0413ed2352779df27dc3dd48f473366c2"} Jul 23 22:23:21.121389 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:21.121368 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:21.506660 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:21.506626 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:21.801670 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:21.801597 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pl657" Jul 23 22:23:21.801670 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:21.801641 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fd6hg" Jul 23 22:23:21.801837 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:21.801701 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ks6hk" Jul 23 22:23:21.801837 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:21.801715 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pl657" podUID="81890460-aa07-4749-aadd-909c876b9244" Jul 23 22:23:21.801837 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:21.801773 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ks6hk" podUID="2d81f7cf-acbc-4389-b9fb-e621c3c060d4" Jul 23 22:23:21.801953 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:21.801837 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fd6hg" podUID="fc3410ae-ba34-41dc-b992-c51a7bd26fd4" Jul 23 22:23:22.010200 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:22.010167 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:22.303358 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:22.303332 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:22.712742 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:22.712716 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:22.907529 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:22.907503 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:23.013973 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:23.013900 2575 generic.go:356] "Generic (PLEG): container finished" podID="0dbcc8cc-adc8-472c-976c-f30472ad20b2" containerID="edf87bd1f13f75f687b93f12079dd2f1f8a03f5a58861c487a2b6c8319067e90" exitCode=0 Jul 23 22:23:23.013973 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:23.013958 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2sdbj" event={"ID":"0dbcc8cc-adc8-472c-976c-f30472ad20b2","Type":"ContainerDied","Data":"edf87bd1f13f75f687b93f12079dd2f1f8a03f5a58861c487a2b6c8319067e90"} Jul 23 22:23:23.292708 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:23.292651 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:23.801560 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:23.801531 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fd6hg" Jul 23 22:23:23.801710 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:23.801650 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ks6hk" Jul 23 22:23:23.801836 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:23.801744 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ks6hk" podUID="2d81f7cf-acbc-4389-b9fb-e621c3c060d4" Jul 23 22:23:23.801836 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:23.801644 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fd6hg" podUID="fc3410ae-ba34-41dc-b992-c51a7bd26fd4" Jul 23 22:23:23.801836 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:23.801650 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pl657" Jul 23 22:23:23.801836 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:23.801832 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pl657" podUID="81890460-aa07-4749-aadd-909c876b9244" Jul 23 22:23:24.092898 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:24.092818 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:24.194071 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:24.194030 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:24.301363 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:24.301312 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:24.712365 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:24.712330 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:24.907771 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:24.907723 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:24.976592 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:24.976514 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:25.416430 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:25.416351 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwhn2\" (UniqueName: \"kubernetes.io/projected/2d81f7cf-acbc-4389-b9fb-e621c3c060d4-kube-api-access-hwhn2\") pod \"network-check-target-ks6hk\" (UID: \"2d81f7cf-acbc-4389-b9fb-e621c3c060d4\") " pod="openshift-network-diagnostics/network-check-target-ks6hk" Jul 23 22:23:25.416430 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:25.416415 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc3410ae-ba34-41dc-b992-c51a7bd26fd4-metrics-certs\") pod \"network-metrics-daemon-fd6hg\" (UID: \"fc3410ae-ba34-41dc-b992-c51a7bd26fd4\") " pod="openshift-multus/network-metrics-daemon-fd6hg" Jul 23 22:23:25.416840 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:25.416508 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 22:23:25.416840 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:25.416521 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 22:23:25.416840 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:25.416542 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 22:23:25.416840 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:25.416554 2575 projected.go:196] Error preparing data for projected volume kube-api-access-hwhn2 for pod openshift-network-diagnostics/network-check-target-ks6hk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 22:23:25.416840 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:25.416572 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc3410ae-ba34-41dc-b992-c51a7bd26fd4-metrics-certs podName:fc3410ae-ba34-41dc-b992-c51a7bd26fd4 nodeName:}" failed. No retries permitted until 2026-07-23 22:23:57.416558133 +0000 UTC m=+65.136555373 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fc3410ae-ba34-41dc-b992-c51a7bd26fd4-metrics-certs") pod "network-metrics-daemon-fd6hg" (UID: "fc3410ae-ba34-41dc-b992-c51a7bd26fd4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 22:23:25.416840 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:25.416614 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2d81f7cf-acbc-4389-b9fb-e621c3c060d4-kube-api-access-hwhn2 podName:2d81f7cf-acbc-4389-b9fb-e621c3c060d4 nodeName:}" failed. No retries permitted until 2026-07-23 22:23:57.416589205 +0000 UTC m=+65.136586446 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-hwhn2" (UniqueName: "kubernetes.io/projected/2d81f7cf-acbc-4389-b9fb-e621c3c060d4-kube-api-access-hwhn2") pod "network-check-target-ks6hk" (UID: "2d81f7cf-acbc-4389-b9fb-e621c3c060d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 22:23:25.512860 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:25.512828 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:25.516936 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:25.516909 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/81890460-aa07-4749-aadd-909c876b9244-original-pull-secret\") pod \"global-pull-secret-syncer-pl657\" (UID: \"81890460-aa07-4749-aadd-909c876b9244\") " pod="kube-system/global-pull-secret-syncer-pl657" Jul 23 22:23:25.517104 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:25.517038 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 22:23:25.517104 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:25.517102 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81890460-aa07-4749-aadd-909c876b9244-original-pull-secret podName:81890460-aa07-4749-aadd-909c876b9244 nodeName:}" failed. No retries permitted until 2026-07-23 22:23:57.517086359 +0000 UTC m=+65.237083614 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/81890460-aa07-4749-aadd-909c876b9244-original-pull-secret") pod "global-pull-secret-syncer-pl657" (UID: "81890460-aa07-4749-aadd-909c876b9244") : object "kube-system"/"original-pull-secret" not registered Jul 23 22:23:25.801985 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:25.801956 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ks6hk" Jul 23 22:23:25.802152 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:25.801994 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pl657" Jul 23 22:23:25.802152 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:25.801994 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fd6hg" Jul 23 22:23:25.802152 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:25.802075 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ks6hk" podUID="2d81f7cf-acbc-4389-b9fb-e621c3c060d4" Jul 23 22:23:25.802362 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:25.802191 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fd6hg" podUID="fc3410ae-ba34-41dc-b992-c51a7bd26fd4" Jul 23 22:23:25.802362 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:25.802274 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pl657" podUID="81890460-aa07-4749-aadd-909c876b9244" Jul 23 22:23:25.945108 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:25.945072 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:26.094012 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:26.093930 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:26.491531 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:26.491290 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:26.708678 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:26.708636 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:27.292879 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:27.292845 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:27.697384 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:27.697362 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:27.801839 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:27.801823 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fd6hg" Jul 23 22:23:27.801930 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:27.801823 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ks6hk" Jul 23 22:23:27.801930 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:27.801911 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fd6hg" podUID="fc3410ae-ba34-41dc-b992-c51a7bd26fd4" Jul 23 22:23:27.801992 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:27.801823 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pl657" Jul 23 22:23:27.802038 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:27.801974 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ks6hk" podUID="2d81f7cf-acbc-4389-b9fb-e621c3c060d4" Jul 23 22:23:27.802080 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:27.802064 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pl657" podUID="81890460-aa07-4749-aadd-909c876b9244" Jul 23 22:23:27.914776 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:27.914751 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:28.026622 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:28.026576 2575 generic.go:356] "Generic (PLEG): container finished" podID="0dbcc8cc-adc8-472c-976c-f30472ad20b2" containerID="e3fabce9eb8ea3eb58b02e258e7f7174361b7b5d8dfcc475b0b3c9a9a0673ef7" exitCode=0 Jul 23 22:23:28.026622 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:28.026610 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2sdbj" event={"ID":"0dbcc8cc-adc8-472c-976c-f30472ad20b2","Type":"ContainerDied","Data":"e3fabce9eb8ea3eb58b02e258e7f7174361b7b5d8dfcc475b0b3c9a9a0673ef7"} Jul 23 22:23:28.097208 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:28.097186 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:28.492952 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:28.492927 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:28.723501 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:28.723463 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:28.794046 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:28.793980 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:29.032561 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:29.032526 2575 generic.go:356] "Generic (PLEG): container finished" podID="0dbcc8cc-adc8-472c-976c-f30472ad20b2" containerID="781ea7b3216ddbbb9fc23c7404f6f7e57bf0fa6eee78dd9f73f48a13847eb2ec" exitCode=0 Jul 23 22:23:29.032689 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:29.032572 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2sdbj" event={"ID":"0dbcc8cc-adc8-472c-976c-f30472ad20b2","Type":"ContainerDied","Data":"781ea7b3216ddbbb9fc23c7404f6f7e57bf0fa6eee78dd9f73f48a13847eb2ec"} Jul 23 22:23:29.096492 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:29.096467 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:29.711426 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:29.711404 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:29.801585 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:29.801568 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fd6hg" Jul 23 22:23:29.801981 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:29.801568 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ks6hk" Jul 23 22:23:29.801981 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:29.801648 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fd6hg" podUID="fc3410ae-ba34-41dc-b992-c51a7bd26fd4" Jul 23 22:23:29.801981 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:29.801721 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ks6hk" podUID="2d81f7cf-acbc-4389-b9fb-e621c3c060d4" Jul 23 22:23:29.801981 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:29.801568 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pl657" Jul 23 22:23:29.801981 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:29.801809 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pl657" podUID="81890460-aa07-4749-aadd-909c876b9244" Jul 23 22:23:29.912866 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:29.912843 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:30.011922 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:30.011879 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:30.037188 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:30.037164 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2sdbj" event={"ID":"0dbcc8cc-adc8-472c-976c-f30472ad20b2","Type":"ContainerStarted","Data":"d9958a85cb856a97a4178f98cca5f72b99dd47aee34ab4c1e0106a4d3ba23034"} Jul 23 22:23:30.061730 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:30.061670 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-2sdbj" podStartSLOduration=8.675740919999999 podStartE2EDuration="38.061655449s" totalImagesPullingTime="29.385914529s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 22:22:52 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:23:30.060583565 +0000 UTC m=+37.780580826" watchObservedRunningTime="2026-07-23 22:23:30.061655449 +0000 UTC m=+37.781652712" Jul 23 22:23:30.097973 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:30.097950 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:30.257980 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:30.257952 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:30.357938 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:30.357874 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:30.488963 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:30.488936 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:30.712671 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:30.712652 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:30.901698 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:30.901675 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:30.968974 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:30.968927 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:31.096714 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:31.096693 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:31.802011 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:31.801987 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ks6hk" Jul 23 22:23:31.802154 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:31.802091 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pl657" Jul 23 22:23:31.802154 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:31.802098 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ks6hk" podUID="2d81f7cf-acbc-4389-b9fb-e621c3c060d4" Jul 23 22:23:31.802259 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:31.802170 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pl657" podUID="81890460-aa07-4749-aadd-909c876b9244" Jul 23 22:23:31.802259 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:31.802191 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fd6hg" Jul 23 22:23:31.802259 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:31.802244 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fd6hg" podUID="fc3410ae-ba34-41dc-b992-c51a7bd26fd4" Jul 23 22:23:33.801563 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:33.801530 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ks6hk" Jul 23 22:23:33.801563 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:33.801546 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fd6hg" Jul 23 22:23:33.801910 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:33.801530 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pl657" Jul 23 22:23:33.801910 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:33.801618 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ks6hk" podUID="2d81f7cf-acbc-4389-b9fb-e621c3c060d4" Jul 23 22:23:33.801910 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:33.801714 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fd6hg" podUID="fc3410ae-ba34-41dc-b992-c51a7bd26fd4" Jul 23 22:23:33.801910 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:33.801771 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pl657" podUID="81890460-aa07-4749-aadd-909c876b9244" Jul 23 22:23:35.802130 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:35.802102 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fd6hg" Jul 23 22:23:35.802130 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:35.802121 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pl657" Jul 23 22:23:35.802607 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:35.802102 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ks6hk" Jul 23 22:23:35.802607 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:35.802215 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fd6hg" podUID="fc3410ae-ba34-41dc-b992-c51a7bd26fd4" Jul 23 22:23:35.802607 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:35.802259 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ks6hk" podUID="2d81f7cf-acbc-4389-b9fb-e621c3c060d4" Jul 23 22:23:35.802607 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:35.802338 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pl657" podUID="81890460-aa07-4749-aadd-909c876b9244" Jul 23 22:23:37.801600 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:37.801571 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pl657" Jul 23 22:23:37.802101 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:37.801656 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pl657" podUID="81890460-aa07-4749-aadd-909c876b9244" Jul 23 22:23:37.802101 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:37.801729 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fd6hg" Jul 23 22:23:37.802101 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:37.801804 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fd6hg" podUID="fc3410ae-ba34-41dc-b992-c51a7bd26fd4" Jul 23 22:23:37.802101 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:37.801890 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ks6hk" Jul 23 22:23:37.802101 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:37.801976 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ks6hk" podUID="2d81f7cf-acbc-4389-b9fb-e621c3c060d4" Jul 23 22:23:39.298932 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:39.298901 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:39.504978 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:39.504953 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:39.610060 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:39.610002 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:39.802130 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:39.802103 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pl657" Jul 23 22:23:39.802239 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:39.802195 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fd6hg" Jul 23 22:23:39.802332 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:39.802305 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fd6hg" podUID="fc3410ae-ba34-41dc-b992-c51a7bd26fd4" Jul 23 22:23:39.802332 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:39.802200 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ks6hk" Jul 23 22:23:39.802416 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:39.802198 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pl657" podUID="81890460-aa07-4749-aadd-909c876b9244" Jul 23 22:23:39.802416 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:39.802393 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ks6hk" podUID="2d81f7cf-acbc-4389-b9fb-e621c3c060d4" Jul 23 22:23:40.110739 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.110719 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-206.ec2.internal" event="NodeReady" Jul 23 22:23:40.110841 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.110795 2575 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 23 22:23:40.153625 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.153606 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-56f57fb769-nnwh2"] Jul 23 22:23:40.173655 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.173635 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56f57fb769-nnwh2" Jul 23 22:23:40.176382 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.176364 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dk6d4\"" Jul 23 22:23:40.176545 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.176524 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 23 22:23:40.176636 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.176618 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-56f57fb769-nnwh2"] Jul 23 22:23:40.176757 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.176743 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 23 22:23:40.177309 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.177294 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-mqb8v"] Jul 23 22:23:40.183909 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.183893 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 23 22:23:40.190739 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.190722 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 23 22:23:40.193545 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.193521 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-ldpfb"] Jul 23 22:23:40.193638 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.193624 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mqb8v" Jul 23 22:23:40.198512 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.198496 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-fmr8p\"" Jul 23 22:23:40.198609 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.198522 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 23 22:23:40.198609 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.198538 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 23 22:23:40.207640 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.207624 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ldpfb" Jul 23 22:23:40.212681 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.212610 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-6t6v4\"" Jul 23 22:23:40.212956 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.212932 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 23 22:23:40.214200 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.214179 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 23 22:23:40.214447 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.214427 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 23 22:23:40.215664 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.215640 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mqb8v"] Jul 23 22:23:40.235873 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.235853 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ldpfb"] Jul 23 22:23:40.282381 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.282360 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-5mx76"] Jul 23 22:23:40.301772 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.301757 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5mx76" Jul 23 22:23:40.310445 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.310429 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 23 22:23:40.310445 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.310437 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 23 22:23:40.310795 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.310784 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 23 22:23:40.310854 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.310788 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-h4r9r\"" Jul 23 22:23:40.310963 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.310951 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 23 22:23:40.318647 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.318629 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5mx76"] Jul 23 22:23:40.326785 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.326765 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bd489273-20d6-4e66-98ae-9a3616fac8e1-trusted-ca\") pod \"image-registry-56f57fb769-nnwh2\" (UID: \"bd489273-20d6-4e66-98ae-9a3616fac8e1\") " pod="openshift-image-registry/image-registry-56f57fb769-nnwh2" Jul 23 22:23:40.326872 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.326796 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bd489273-20d6-4e66-98ae-9a3616fac8e1-image-registry-private-configuration\") pod \"image-registry-56f57fb769-nnwh2\" (UID: \"bd489273-20d6-4e66-98ae-9a3616fac8e1\") " pod="openshift-image-registry/image-registry-56f57fb769-nnwh2" Jul 23 22:23:40.326872 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.326817 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dbc57266-9fac-4ed8-b4b9-1adcfe33c3d6-tmp-dir\") pod \"dns-default-mqb8v\" (UID: \"dbc57266-9fac-4ed8-b4b9-1adcfe33c3d6\") " pod="openshift-dns/dns-default-mqb8v" Jul 23 22:23:40.326872 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.326838 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bd489273-20d6-4e66-98ae-9a3616fac8e1-installation-pull-secrets\") pod \"image-registry-56f57fb769-nnwh2\" (UID: \"bd489273-20d6-4e66-98ae-9a3616fac8e1\") " pod="openshift-image-registry/image-registry-56f57fb769-nnwh2" Jul 23 22:23:40.326963 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.326892 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8sm5\" (UniqueName: \"kubernetes.io/projected/dbc57266-9fac-4ed8-b4b9-1adcfe33c3d6-kube-api-access-f8sm5\") pod \"dns-default-mqb8v\" (UID: \"dbc57266-9fac-4ed8-b4b9-1adcfe33c3d6\") " pod="openshift-dns/dns-default-mqb8v" Jul 23 22:23:40.326963 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.326925 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bd489273-20d6-4e66-98ae-9a3616fac8e1-registry-tls\") pod \"image-registry-56f57fb769-nnwh2\" (UID: \"bd489273-20d6-4e66-98ae-9a3616fac8e1\") " pod="openshift-image-registry/image-registry-56f57fb769-nnwh2" Jul 23 22:23:40.326963 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.326943 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bd489273-20d6-4e66-98ae-9a3616fac8e1-ca-trust-extracted\") pod \"image-registry-56f57fb769-nnwh2\" (UID: \"bd489273-20d6-4e66-98ae-9a3616fac8e1\") " pod="openshift-image-registry/image-registry-56f57fb769-nnwh2" Jul 23 22:23:40.326963 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.326959 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8q69x\" (UniqueName: \"kubernetes.io/projected/ce4e1208-e25f-4d28-bbce-5a10feadf578-kube-api-access-8q69x\") pod \"ingress-canary-ldpfb\" (UID: \"ce4e1208-e25f-4d28-bbce-5a10feadf578\") " pod="openshift-ingress-canary/ingress-canary-ldpfb" Jul 23 22:23:40.327134 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.326975 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dbc57266-9fac-4ed8-b4b9-1adcfe33c3d6-config-volume\") pod \"dns-default-mqb8v\" (UID: \"dbc57266-9fac-4ed8-b4b9-1adcfe33c3d6\") " pod="openshift-dns/dns-default-mqb8v" Jul 23 22:23:40.327134 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.327065 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ce4e1208-e25f-4d28-bbce-5a10feadf578-cert\") pod \"ingress-canary-ldpfb\" (UID: \"ce4e1208-e25f-4d28-bbce-5a10feadf578\") " pod="openshift-ingress-canary/ingress-canary-ldpfb" Jul 23 22:23:40.327134 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.327085 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dbc57266-9fac-4ed8-b4b9-1adcfe33c3d6-metrics-tls\") pod \"dns-default-mqb8v\" (UID: \"dbc57266-9fac-4ed8-b4b9-1adcfe33c3d6\") " pod="openshift-dns/dns-default-mqb8v" Jul 23 22:23:40.327134 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.327102 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bd489273-20d6-4e66-98ae-9a3616fac8e1-registry-certificates\") pod \"image-registry-56f57fb769-nnwh2\" (UID: \"bd489273-20d6-4e66-98ae-9a3616fac8e1\") " pod="openshift-image-registry/image-registry-56f57fb769-nnwh2" Jul 23 22:23:40.327134 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.327121 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bd489273-20d6-4e66-98ae-9a3616fac8e1-bound-sa-token\") pod \"image-registry-56f57fb769-nnwh2\" (UID: \"bd489273-20d6-4e66-98ae-9a3616fac8e1\") " pod="openshift-image-registry/image-registry-56f57fb769-nnwh2" Jul 23 22:23:40.327270 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.327137 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mr4tn\" (UniqueName: \"kubernetes.io/projected/bd489273-20d6-4e66-98ae-9a3616fac8e1-kube-api-access-mr4tn\") pod \"image-registry-56f57fb769-nnwh2\" (UID: \"bd489273-20d6-4e66-98ae-9a3616fac8e1\") " pod="openshift-image-registry/image-registry-56f57fb769-nnwh2" Jul 23 22:23:40.427748 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.427727 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8sm5\" (UniqueName: \"kubernetes.io/projected/dbc57266-9fac-4ed8-b4b9-1adcfe33c3d6-kube-api-access-f8sm5\") pod \"dns-default-mqb8v\" (UID: \"dbc57266-9fac-4ed8-b4b9-1adcfe33c3d6\") " pod="openshift-dns/dns-default-mqb8v" Jul 23 22:23:40.427841 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.427756 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bd489273-20d6-4e66-98ae-9a3616fac8e1-registry-tls\") pod \"image-registry-56f57fb769-nnwh2\" (UID: \"bd489273-20d6-4e66-98ae-9a3616fac8e1\") " pod="openshift-image-registry/image-registry-56f57fb769-nnwh2" Jul 23 22:23:40.427841 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.427778 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bd489273-20d6-4e66-98ae-9a3616fac8e1-ca-trust-extracted\") pod \"image-registry-56f57fb769-nnwh2\" (UID: \"bd489273-20d6-4e66-98ae-9a3616fac8e1\") " pod="openshift-image-registry/image-registry-56f57fb769-nnwh2" Jul 23 22:23:40.427946 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.427904 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2a15f276-17ef-41fe-b658-8adfb01e8077-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5mx76\" (UID: \"2a15f276-17ef-41fe-b658-8adfb01e8077\") " pod="openshift-insights/insights-runtime-extractor-5mx76" Jul 23 22:23:40.427999 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.427943 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8q69x\" (UniqueName: \"kubernetes.io/projected/ce4e1208-e25f-4d28-bbce-5a10feadf578-kube-api-access-8q69x\") pod \"ingress-canary-ldpfb\" (UID: \"ce4e1208-e25f-4d28-bbce-5a10feadf578\") " pod="openshift-ingress-canary/ingress-canary-ldpfb" Jul 23 22:23:40.427999 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.427967 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dbc57266-9fac-4ed8-b4b9-1adcfe33c3d6-config-volume\") pod \"dns-default-mqb8v\" (UID: \"dbc57266-9fac-4ed8-b4b9-1adcfe33c3d6\") " pod="openshift-dns/dns-default-mqb8v" Jul 23 22:23:40.428132 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.428044 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ce4e1208-e25f-4d28-bbce-5a10feadf578-cert\") pod \"ingress-canary-ldpfb\" (UID: \"ce4e1208-e25f-4d28-bbce-5a10feadf578\") " pod="openshift-ingress-canary/ingress-canary-ldpfb" Jul 23 22:23:40.428132 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.428068 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dbc57266-9fac-4ed8-b4b9-1adcfe33c3d6-metrics-tls\") pod \"dns-default-mqb8v\" (UID: \"dbc57266-9fac-4ed8-b4b9-1adcfe33c3d6\") " pod="openshift-dns/dns-default-mqb8v" Jul 23 22:23:40.428132 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.428087 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bd489273-20d6-4e66-98ae-9a3616fac8e1-registry-certificates\") pod \"image-registry-56f57fb769-nnwh2\" (UID: \"bd489273-20d6-4e66-98ae-9a3616fac8e1\") " pod="openshift-image-registry/image-registry-56f57fb769-nnwh2" Jul 23 22:23:40.428132 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.428113 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bd489273-20d6-4e66-98ae-9a3616fac8e1-bound-sa-token\") pod \"image-registry-56f57fb769-nnwh2\" (UID: \"bd489273-20d6-4e66-98ae-9a3616fac8e1\") " pod="openshift-image-registry/image-registry-56f57fb769-nnwh2" Jul 23 22:23:40.428400 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.428136 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mr4tn\" (UniqueName: \"kubernetes.io/projected/bd489273-20d6-4e66-98ae-9a3616fac8e1-kube-api-access-mr4tn\") pod \"image-registry-56f57fb769-nnwh2\" (UID: \"bd489273-20d6-4e66-98ae-9a3616fac8e1\") " pod="openshift-image-registry/image-registry-56f57fb769-nnwh2" Jul 23 22:23:40.428400 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.428151 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bd489273-20d6-4e66-98ae-9a3616fac8e1-ca-trust-extracted\") pod \"image-registry-56f57fb769-nnwh2\" (UID: \"bd489273-20d6-4e66-98ae-9a3616fac8e1\") " pod="openshift-image-registry/image-registry-56f57fb769-nnwh2" Jul 23 22:23:40.428400 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.428164 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2a15f276-17ef-41fe-b658-8adfb01e8077-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5mx76\" (UID: \"2a15f276-17ef-41fe-b658-8adfb01e8077\") " pod="openshift-insights/insights-runtime-extractor-5mx76" Jul 23 22:23:40.428400 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.428206 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2a15f276-17ef-41fe-b658-8adfb01e8077-data-volume\") pod \"insights-runtime-extractor-5mx76\" (UID: \"2a15f276-17ef-41fe-b658-8adfb01e8077\") " pod="openshift-insights/insights-runtime-extractor-5mx76" Jul 23 22:23:40.428400 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.428251 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bd489273-20d6-4e66-98ae-9a3616fac8e1-trusted-ca\") pod \"image-registry-56f57fb769-nnwh2\" (UID: \"bd489273-20d6-4e66-98ae-9a3616fac8e1\") " pod="openshift-image-registry/image-registry-56f57fb769-nnwh2" Jul 23 22:23:40.428400 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.428281 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9rlq\" (UniqueName: \"kubernetes.io/projected/2a15f276-17ef-41fe-b658-8adfb01e8077-kube-api-access-f9rlq\") pod \"insights-runtime-extractor-5mx76\" (UID: \"2a15f276-17ef-41fe-b658-8adfb01e8077\") " pod="openshift-insights/insights-runtime-extractor-5mx76" Jul 23 22:23:40.428400 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.428311 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bd489273-20d6-4e66-98ae-9a3616fac8e1-image-registry-private-configuration\") pod \"image-registry-56f57fb769-nnwh2\" (UID: \"bd489273-20d6-4e66-98ae-9a3616fac8e1\") " pod="openshift-image-registry/image-registry-56f57fb769-nnwh2" Jul 23 22:23:40.428400 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.428339 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2a15f276-17ef-41fe-b658-8adfb01e8077-crio-socket\") pod \"insights-runtime-extractor-5mx76\" (UID: \"2a15f276-17ef-41fe-b658-8adfb01e8077\") " pod="openshift-insights/insights-runtime-extractor-5mx76" Jul 23 22:23:40.428400 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.428381 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dbc57266-9fac-4ed8-b4b9-1adcfe33c3d6-tmp-dir\") pod \"dns-default-mqb8v\" (UID: \"dbc57266-9fac-4ed8-b4b9-1adcfe33c3d6\") " pod="openshift-dns/dns-default-mqb8v" Jul 23 22:23:40.428836 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.428414 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bd489273-20d6-4e66-98ae-9a3616fac8e1-installation-pull-secrets\") pod \"image-registry-56f57fb769-nnwh2\" (UID: \"bd489273-20d6-4e66-98ae-9a3616fac8e1\") " pod="openshift-image-registry/image-registry-56f57fb769-nnwh2" Jul 23 22:23:40.428836 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.428705 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dbc57266-9fac-4ed8-b4b9-1adcfe33c3d6-config-volume\") pod \"dns-default-mqb8v\" (UID: \"dbc57266-9fac-4ed8-b4b9-1adcfe33c3d6\") " pod="openshift-dns/dns-default-mqb8v" Jul 23 22:23:40.429080 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.429057 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bd489273-20d6-4e66-98ae-9a3616fac8e1-registry-certificates\") pod \"image-registry-56f57fb769-nnwh2\" (UID: \"bd489273-20d6-4e66-98ae-9a3616fac8e1\") " pod="openshift-image-registry/image-registry-56f57fb769-nnwh2" Jul 23 22:23:40.429153 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.429107 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dbc57266-9fac-4ed8-b4b9-1adcfe33c3d6-tmp-dir\") pod \"dns-default-mqb8v\" (UID: \"dbc57266-9fac-4ed8-b4b9-1adcfe33c3d6\") " pod="openshift-dns/dns-default-mqb8v" Jul 23 22:23:40.429257 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.429238 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bd489273-20d6-4e66-98ae-9a3616fac8e1-trusted-ca\") pod \"image-registry-56f57fb769-nnwh2\" (UID: \"bd489273-20d6-4e66-98ae-9a3616fac8e1\") " pod="openshift-image-registry/image-registry-56f57fb769-nnwh2" Jul 23 22:23:40.432277 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.432259 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bd489273-20d6-4e66-98ae-9a3616fac8e1-installation-pull-secrets\") pod \"image-registry-56f57fb769-nnwh2\" (UID: \"bd489273-20d6-4e66-98ae-9a3616fac8e1\") " pod="openshift-image-registry/image-registry-56f57fb769-nnwh2" Jul 23 22:23:40.432362 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.432278 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bd489273-20d6-4e66-98ae-9a3616fac8e1-image-registry-private-configuration\") pod \"image-registry-56f57fb769-nnwh2\" (UID: \"bd489273-20d6-4e66-98ae-9a3616fac8e1\") " pod="openshift-image-registry/image-registry-56f57fb769-nnwh2" Jul 23 22:23:40.432362 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.432296 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bd489273-20d6-4e66-98ae-9a3616fac8e1-registry-tls\") pod \"image-registry-56f57fb769-nnwh2\" (UID: \"bd489273-20d6-4e66-98ae-9a3616fac8e1\") " pod="openshift-image-registry/image-registry-56f57fb769-nnwh2" Jul 23 22:23:40.432362 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.432357 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ce4e1208-e25f-4d28-bbce-5a10feadf578-cert\") pod \"ingress-canary-ldpfb\" (UID: \"ce4e1208-e25f-4d28-bbce-5a10feadf578\") " pod="openshift-ingress-canary/ingress-canary-ldpfb" Jul 23 22:23:40.432466 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.432446 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dbc57266-9fac-4ed8-b4b9-1adcfe33c3d6-metrics-tls\") pod \"dns-default-mqb8v\" (UID: \"dbc57266-9fac-4ed8-b4b9-1adcfe33c3d6\") " pod="openshift-dns/dns-default-mqb8v" Jul 23 22:23:40.456110 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.456086 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mr4tn\" (UniqueName: \"kubernetes.io/projected/bd489273-20d6-4e66-98ae-9a3616fac8e1-kube-api-access-mr4tn\") pod \"image-registry-56f57fb769-nnwh2\" (UID: \"bd489273-20d6-4e66-98ae-9a3616fac8e1\") " pod="openshift-image-registry/image-registry-56f57fb769-nnwh2" Jul 23 22:23:40.456170 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.456116 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bd489273-20d6-4e66-98ae-9a3616fac8e1-bound-sa-token\") pod \"image-registry-56f57fb769-nnwh2\" (UID: \"bd489273-20d6-4e66-98ae-9a3616fac8e1\") " pod="openshift-image-registry/image-registry-56f57fb769-nnwh2" Jul 23 22:23:40.461695 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.461677 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8sm5\" (UniqueName: \"kubernetes.io/projected/dbc57266-9fac-4ed8-b4b9-1adcfe33c3d6-kube-api-access-f8sm5\") pod \"dns-default-mqb8v\" (UID: \"dbc57266-9fac-4ed8-b4b9-1adcfe33c3d6\") " pod="openshift-dns/dns-default-mqb8v" Jul 23 22:23:40.468494 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.468474 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8q69x\" (UniqueName: \"kubernetes.io/projected/ce4e1208-e25f-4d28-bbce-5a10feadf578-kube-api-access-8q69x\") pod \"ingress-canary-ldpfb\" (UID: \"ce4e1208-e25f-4d28-bbce-5a10feadf578\") " pod="openshift-ingress-canary/ingress-canary-ldpfb" Jul 23 22:23:40.483757 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.483737 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56f57fb769-nnwh2" Jul 23 22:23:40.499623 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.499588 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:40.501559 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.501545 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mqb8v" Jul 23 22:23:40.515216 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.515201 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ldpfb" Jul 23 22:23:40.528958 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.528933 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2a15f276-17ef-41fe-b658-8adfb01e8077-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5mx76\" (UID: \"2a15f276-17ef-41fe-b658-8adfb01e8077\") " pod="openshift-insights/insights-runtime-extractor-5mx76" Jul 23 22:23:40.529056 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.528966 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2a15f276-17ef-41fe-b658-8adfb01e8077-data-volume\") pod \"insights-runtime-extractor-5mx76\" (UID: \"2a15f276-17ef-41fe-b658-8adfb01e8077\") " pod="openshift-insights/insights-runtime-extractor-5mx76" Jul 23 22:23:40.529056 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.528988 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9rlq\" (UniqueName: \"kubernetes.io/projected/2a15f276-17ef-41fe-b658-8adfb01e8077-kube-api-access-f9rlq\") pod \"insights-runtime-extractor-5mx76\" (UID: \"2a15f276-17ef-41fe-b658-8adfb01e8077\") " pod="openshift-insights/insights-runtime-extractor-5mx76" Jul 23 22:23:40.529056 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.529005 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2a15f276-17ef-41fe-b658-8adfb01e8077-crio-socket\") pod \"insights-runtime-extractor-5mx76\" (UID: \"2a15f276-17ef-41fe-b658-8adfb01e8077\") " pod="openshift-insights/insights-runtime-extractor-5mx76" Jul 23 22:23:40.529056 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.529051 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2a15f276-17ef-41fe-b658-8adfb01e8077-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5mx76\" (UID: \"2a15f276-17ef-41fe-b658-8adfb01e8077\") " pod="openshift-insights/insights-runtime-extractor-5mx76" Jul 23 22:23:40.529260 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.529242 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2a15f276-17ef-41fe-b658-8adfb01e8077-crio-socket\") pod \"insights-runtime-extractor-5mx76\" (UID: \"2a15f276-17ef-41fe-b658-8adfb01e8077\") " pod="openshift-insights/insights-runtime-extractor-5mx76" Jul 23 22:23:40.529369 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.529350 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2a15f276-17ef-41fe-b658-8adfb01e8077-data-volume\") pod \"insights-runtime-extractor-5mx76\" (UID: \"2a15f276-17ef-41fe-b658-8adfb01e8077\") " pod="openshift-insights/insights-runtime-extractor-5mx76" Jul 23 22:23:40.529515 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.529495 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2a15f276-17ef-41fe-b658-8adfb01e8077-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5mx76\" (UID: \"2a15f276-17ef-41fe-b658-8adfb01e8077\") " pod="openshift-insights/insights-runtime-extractor-5mx76" Jul 23 22:23:40.530907 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.530889 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2a15f276-17ef-41fe-b658-8adfb01e8077-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5mx76\" (UID: \"2a15f276-17ef-41fe-b658-8adfb01e8077\") " pod="openshift-insights/insights-runtime-extractor-5mx76" Jul 23 22:23:40.546978 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.546954 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9rlq\" (UniqueName: \"kubernetes.io/projected/2a15f276-17ef-41fe-b658-8adfb01e8077-kube-api-access-f9rlq\") pod \"insights-runtime-extractor-5mx76\" (UID: \"2a15f276-17ef-41fe-b658-8adfb01e8077\") " pod="openshift-insights/insights-runtime-extractor-5mx76" Jul 23 22:23:40.609119 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.609087 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5mx76" Jul 23 22:23:40.646825 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.645846 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:40.704666 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.704633 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-56f57fb769-nnwh2"] Jul 23 22:23:40.708875 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:23:40.708851 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd489273_20d6_4e66_98ae_9a3616fac8e1.slice/crio-f6d9b875dd78626daaa843a5768777d8ded4169161bc1938e60f4d1e189cc8cc WatchSource:0}: Error finding container f6d9b875dd78626daaa843a5768777d8ded4169161bc1938e60f4d1e189cc8cc: Status 404 returned error can't find the container with id f6d9b875dd78626daaa843a5768777d8ded4169161bc1938e60f4d1e189cc8cc Jul 23 22:23:40.721269 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.721243 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mqb8v"] Jul 23 22:23:40.725225 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:23:40.725201 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbc57266_9fac_4ed8_b4b9_1adcfe33c3d6.slice/crio-7c003feb808a1e0279ffbce99af5a6f3a9d6a4def609038f685598f55354c4c6 WatchSource:0}: Error finding container 7c003feb808a1e0279ffbce99af5a6f3a9d6a4def609038f685598f55354c4c6: Status 404 returned error can't find the container with id 7c003feb808a1e0279ffbce99af5a6f3a9d6a4def609038f685598f55354c4c6 Jul 23 22:23:40.742303 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.742278 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ldpfb"] Jul 23 22:23:40.750116 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.750096 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:40.753188 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:23:40.753165 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce4e1208_e25f_4d28_bbce_5a10feadf578.slice/crio-7f9a083303d2d010061a2f4459a09de233d13a052d3d441d9e958917dff56f8a WatchSource:0}: Error finding container 7f9a083303d2d010061a2f4459a09de233d13a052d3d441d9e958917dff56f8a: Status 404 returned error can't find the container with id 7f9a083303d2d010061a2f4459a09de233d13a052d3d441d9e958917dff56f8a Jul 23 22:23:40.785631 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.785611 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5mx76"] Jul 23 22:23:40.788418 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:23:40.788392 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a15f276_17ef_41fe_b658_8adfb01e8077.slice/crio-d9f671d5b12ed00531fb21e02decb443500f753e0297b44c33f7b149b7c1ff5e WatchSource:0}: Error finding container d9f671d5b12ed00531fb21e02decb443500f753e0297b44c33f7b149b7c1ff5e: Status 404 returned error can't find the container with id d9f671d5b12ed00531fb21e02decb443500f753e0297b44c33f7b149b7c1ff5e Jul 23 22:23:40.856675 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:40.856651 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:41.059140 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:41.059063 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5mx76" event={"ID":"2a15f276-17ef-41fe-b658-8adfb01e8077","Type":"ContainerStarted","Data":"d9f671d5b12ed00531fb21e02decb443500f753e0297b44c33f7b149b7c1ff5e"} Jul 23 22:23:41.060216 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:41.060177 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ldpfb" event={"ID":"ce4e1208-e25f-4d28-bbce-5a10feadf578","Type":"ContainerStarted","Data":"7f9a083303d2d010061a2f4459a09de233d13a052d3d441d9e958917dff56f8a"} Jul 23 22:23:41.061358 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:41.061330 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mqb8v" event={"ID":"dbc57266-9fac-4ed8-b4b9-1adcfe33c3d6","Type":"ContainerStarted","Data":"7c003feb808a1e0279ffbce99af5a6f3a9d6a4def609038f685598f55354c4c6"} Jul 23 22:23:41.062850 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:41.062823 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-56f57fb769-nnwh2" event={"ID":"bd489273-20d6-4e66-98ae-9a3616fac8e1","Type":"ContainerStarted","Data":"881985bb47641391e41f8150f7b0f995dfa019b2251c02af6415a547ea46c19c"} Jul 23 22:23:41.062932 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:41.062868 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-56f57fb769-nnwh2" event={"ID":"bd489273-20d6-4e66-98ae-9a3616fac8e1","Type":"ContainerStarted","Data":"f6d9b875dd78626daaa843a5768777d8ded4169161bc1938e60f4d1e189cc8cc"} Jul 23 22:23:41.062982 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:41.062962 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-56f57fb769-nnwh2" Jul 23 22:23:41.801966 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:41.801933 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pl657" Jul 23 22:23:41.802411 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:41.801946 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fd6hg" Jul 23 22:23:41.802411 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:41.802129 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ks6hk" Jul 23 22:23:41.805845 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:41.805811 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 23 22:23:41.807422 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:41.807377 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-655rt\"" Jul 23 22:23:41.807681 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:41.807665 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2pbtn\"" Jul 23 22:23:41.807758 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:41.807746 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 23 22:23:41.807920 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:41.807894 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 23 22:23:41.808035 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:41.807984 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 23 22:23:43.720217 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:43.720176 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:43.798759 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:43.798732 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:48.083734 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:48.083698 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5mx76" event={"ID":"2a15f276-17ef-41fe-b658-8adfb01e8077","Type":"ContainerStarted","Data":"1a38488a1eee2e7288d16a64dd01b1081cdefb08c07ffe06abbd44824a74cdc9"} Jul 23 22:23:48.085470 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:48.085430 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ldpfb" event={"ID":"ce4e1208-e25f-4d28-bbce-5a10feadf578","Type":"ContainerStarted","Data":"b5cf70a6485b1c241c85d097cd0bdd1b4b1295a76c0f242834d0af9bd890560b"} Jul 23 22:23:48.087278 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:48.087251 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mqb8v" event={"ID":"dbc57266-9fac-4ed8-b4b9-1adcfe33c3d6","Type":"ContainerStarted","Data":"920c7db6242f946ac92d760852133eade8949a0f13af51280b2c032856dee4d6"} Jul 23 22:23:48.087387 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:48.087297 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mqb8v" event={"ID":"dbc57266-9fac-4ed8-b4b9-1adcfe33c3d6","Type":"ContainerStarted","Data":"6b0692400dad4329aa920f238318def1056edb62da235571ae1f12b6472224fe"} Jul 23 22:23:48.087445 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:48.087405 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-mqb8v" Jul 23 22:23:48.113497 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:48.113450 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-56f57fb769-nnwh2" podStartSLOduration=9.113420545 podStartE2EDuration="9.113420545s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 22:23:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:23:41.121376147 +0000 UTC m=+48.841373411" watchObservedRunningTime="2026-07-23 22:23:48.113420545 +0000 UTC m=+55.833417801" Jul 23 22:23:48.113626 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:48.113602 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-ldpfb" podStartSLOduration=1.7906775499999998 podStartE2EDuration="8.113594201s" totalImagesPullingTime="6.322916651s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 22:23:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:23:48.11206038 +0000 UTC m=+55.832057669" watchObservedRunningTime="2026-07-23 22:23:48.113594201 +0000 UTC m=+55.833591461" Jul 23 22:23:48.146543 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:48.146488 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-mqb8v" podStartSLOduration=1.795921405 podStartE2EDuration="8.146469372s" totalImagesPullingTime="6.350547967s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 22:23:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:23:48.145011094 +0000 UTC m=+55.865008380" watchObservedRunningTime="2026-07-23 22:23:48.146469372 +0000 UTC m=+55.866466633" Jul 23 22:23:50.143297 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:50.143264 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:50.244529 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:50.244475 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:50.332359 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:50.332313 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-phx4w"] Jul 23 22:23:50.332655 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:50.332623 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:50.349261 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:50.349225 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-phx4w"] Jul 23 22:23:50.349404 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:50.349329 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-phx4w" Jul 23 22:23:50.352347 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:50.352279 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 23 22:23:50.352547 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:50.352355 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-565c7\"" Jul 23 22:23:50.407572 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:50.407514 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/850f951d-31d4-4880-9dc7-22cbed5f9237-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-phx4w\" (UID: \"850f951d-31d4-4880-9dc7-22cbed5f9237\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-phx4w" Jul 23 22:23:50.473056 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:50.473007 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:50.507956 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:50.507928 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/850f951d-31d4-4880-9dc7-22cbed5f9237-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-phx4w\" (UID: \"850f951d-31d4-4880-9dc7-22cbed5f9237\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-phx4w" Jul 23 22:23:50.510364 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:50.510339 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/850f951d-31d4-4880-9dc7-22cbed5f9237-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-phx4w\" (UID: \"850f951d-31d4-4880-9dc7-22cbed5f9237\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-phx4w" Jul 23 22:23:50.573116 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:50.573091 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:50.661180 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:50.661100 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-phx4w" Jul 23 22:23:50.672746 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:50.672720 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:50.933581 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:50.933555 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:51.004953 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:51.004927 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:51.189397 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:51.189302 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-phx4w"] Jul 23 22:23:51.192364 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:23:51.192341 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod850f951d_31d4_4880_9dc7_22cbed5f9237.slice/crio-ed5b8445e0996d6dcdbbf88a50ecaee021a07061ae706ccb9945b356f3d1e1c7 WatchSource:0}: Error finding container ed5b8445e0996d6dcdbbf88a50ecaee021a07061ae706ccb9945b356f3d1e1c7: Status 404 returned error can't find the container with id ed5b8445e0996d6dcdbbf88a50ecaee021a07061ae706ccb9945b356f3d1e1c7 Jul 23 22:23:52.020886 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:52.020859 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hrvdq" Jul 23 22:23:52.101887 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:52.101848 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5mx76" event={"ID":"2a15f276-17ef-41fe-b658-8adfb01e8077","Type":"ContainerStarted","Data":"e602a53e128adf5dd44cc9918ebb3492e1172cc83fe0cf658d64c7d32f1e01b6"} Jul 23 22:23:52.103404 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:52.103371 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-phx4w" event={"ID":"850f951d-31d4-4880-9dc7-22cbed5f9237","Type":"ContainerStarted","Data":"ed5b8445e0996d6dcdbbf88a50ecaee021a07061ae706ccb9945b356f3d1e1c7"} Jul 23 22:23:52.150264 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:52.150205 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:52.249634 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:52.249606 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:52.321403 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:52.321329 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:53.108137 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:53.108098 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-phx4w" event={"ID":"850f951d-31d4-4880-9dc7-22cbed5f9237","Type":"ContainerStarted","Data":"44b6372fb31af567b26f8f822ffe10309469065a1027f5a30a53820979af5ea7"} Jul 23 22:23:53.108330 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:53.108306 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-phx4w" Jul 23 22:23:53.113593 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:53.113569 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-phx4w" Jul 23 22:23:53.124792 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:53.124745 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-phx4w" podStartSLOduration=1.664262189 podStartE2EDuration="3.124729778s" totalImagesPullingTime="1.460467589s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 22:23:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:23:53.123758873 +0000 UTC m=+60.843756135" watchObservedRunningTime="2026-07-23 22:23:53.124729778 +0000 UTC m=+60.844727040" Jul 23 22:23:53.347173 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:53.347139 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:53.421736 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:53.421642 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:53.893566 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:53.893385 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:54.248707 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:54.248671 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:54.334943 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:54.334911 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:54.547166 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:54.547145 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:54.681941 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:54.681922 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:54.743960 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:54.743941 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:54.883734 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:54.883688 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:55.115484 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:55.115463 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5mx76" event={"ID":"2a15f276-17ef-41fe-b658-8adfb01e8077","Type":"ContainerStarted","Data":"96f80beb83292c20cc39598e6e3e23cadeba0d703677ffddd513e4e48993139e"} Jul 23 22:23:55.138161 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:55.138102 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-5mx76" podStartSLOduration=1.5744088349999998 podStartE2EDuration="15.138088777s" totalImagesPullingTime="13.563679942s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 22:23:40 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:23:55.136989592 +0000 UTC m=+62.856986852" watchObservedRunningTime="2026-07-23 22:23:55.138088777 +0000 UTC m=+62.858086036" Jul 23 22:23:55.915361 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:55.915336 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:56.015598 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:56.015576 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:56.093591 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:56.093569 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:56.291845 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:56.291823 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:56.438723 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:56.438698 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:56.921721 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:56.921697 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:56.995633 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:56.995607 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:57.455827 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:57.455798 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwhn2\" (UniqueName: \"kubernetes.io/projected/2d81f7cf-acbc-4389-b9fb-e621c3c060d4-kube-api-access-hwhn2\") pod \"network-check-target-ks6hk\" (UID: \"2d81f7cf-acbc-4389-b9fb-e621c3c060d4\") " pod="openshift-network-diagnostics/network-check-target-ks6hk" Jul 23 22:23:57.455939 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:57.455851 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc3410ae-ba34-41dc-b992-c51a7bd26fd4-metrics-certs\") pod \"network-metrics-daemon-fd6hg\" (UID: \"fc3410ae-ba34-41dc-b992-c51a7bd26fd4\") " pod="openshift-multus/network-metrics-daemon-fd6hg" Jul 23 22:23:57.458046 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:57.458016 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 23 22:23:57.458834 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:57.458820 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 23 22:23:57.468708 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:57.468690 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc3410ae-ba34-41dc-b992-c51a7bd26fd4-metrics-certs\") pod \"network-metrics-daemon-fd6hg\" (UID: \"fc3410ae-ba34-41dc-b992-c51a7bd26fd4\") " pod="openshift-multus/network-metrics-daemon-fd6hg" Jul 23 22:23:57.468986 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:57.468973 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 23 22:23:57.478854 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:57.478837 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwhn2\" (UniqueName: \"kubernetes.io/projected/2d81f7cf-acbc-4389-b9fb-e621c3c060d4-kube-api-access-hwhn2\") pod \"network-check-target-ks6hk\" (UID: \"2d81f7cf-acbc-4389-b9fb-e621c3c060d4\") " pod="openshift-network-diagnostics/network-check-target-ks6hk" Jul 23 22:23:57.556929 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:57.556907 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/81890460-aa07-4749-aadd-909c876b9244-original-pull-secret\") pod \"global-pull-secret-syncer-pl657\" (UID: \"81890460-aa07-4749-aadd-909c876b9244\") " pod="kube-system/global-pull-secret-syncer-pl657" Jul 23 22:23:57.559378 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:57.559361 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 23 22:23:57.569387 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:57.569370 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/81890460-aa07-4749-aadd-909c876b9244-original-pull-secret\") pod \"global-pull-secret-syncer-pl657\" (UID: \"81890460-aa07-4749-aadd-909c876b9244\") " pod="kube-system/global-pull-secret-syncer-pl657" Jul 23 22:23:57.716087 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:57.716039 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pl657" Jul 23 22:23:57.730319 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:57.730303 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2pbtn\"" Jul 23 22:23:57.736813 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:57.736798 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-655rt\"" Jul 23 22:23:57.737846 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:57.737832 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fd6hg" Jul 23 22:23:57.745017 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:57.744996 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ks6hk" Jul 23 22:23:57.855937 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:57.855903 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-pl657"] Jul 23 22:23:57.859589 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:23:57.859560 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81890460_aa07_4749_aadd_909c876b9244.slice/crio-fb867be8ba31f2c0d30a3b2b36b699ff40cd900e772a6a269b241e902e6460f2 WatchSource:0}: Error finding container fb867be8ba31f2c0d30a3b2b36b699ff40cd900e772a6a269b241e902e6460f2: Status 404 returned error can't find the container with id fb867be8ba31f2c0d30a3b2b36b699ff40cd900e772a6a269b241e902e6460f2 Jul 23 22:23:57.876949 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:57.876921 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fd6hg"] Jul 23 22:23:57.879447 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:23:57.879422 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc3410ae_ba34_41dc_b992_c51a7bd26fd4.slice/crio-1f071a925c0d1c7e2c3649dd7410563d4384cd53c680faf75436028616190aa8 WatchSource:0}: Error finding container 1f071a925c0d1c7e2c3649dd7410563d4384cd53c680faf75436028616190aa8: Status 404 returned error can't find the container with id 1f071a925c0d1c7e2c3649dd7410563d4384cd53c680faf75436028616190aa8 Jul 23 22:23:57.896079 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:57.896058 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ks6hk"] Jul 23 22:23:57.900486 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:23:57.900459 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d81f7cf_acbc_4389_b9fb_e621c3c060d4.slice/crio-eb2430955e3862dd8f42bbc960a6e88e191a0505371c26ea11af8eab7420b909 WatchSource:0}: Error finding container eb2430955e3862dd8f42bbc960a6e88e191a0505371c26ea11af8eab7420b909: Status 404 returned error can't find the container with id eb2430955e3862dd8f42bbc960a6e88e191a0505371c26ea11af8eab7420b909 Jul 23 22:23:58.092575 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:58.092507 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-mqb8v" Jul 23 22:23:58.123966 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:58.123938 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ks6hk" event={"ID":"2d81f7cf-acbc-4389-b9fb-e621c3c060d4","Type":"ContainerStarted","Data":"eb2430955e3862dd8f42bbc960a6e88e191a0505371c26ea11af8eab7420b909"} Jul 23 22:23:58.125341 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:58.125306 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fd6hg" event={"ID":"fc3410ae-ba34-41dc-b992-c51a7bd26fd4","Type":"ContainerStarted","Data":"1f071a925c0d1c7e2c3649dd7410563d4384cd53c680faf75436028616190aa8"} Jul 23 22:23:58.126501 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:58.126477 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-pl657" event={"ID":"81890460-aa07-4749-aadd-909c876b9244","Type":"ContainerStarted","Data":"fb867be8ba31f2c0d30a3b2b36b699ff40cd900e772a6a269b241e902e6460f2"} Jul 23 22:23:58.504753 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:58.504665 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:58.592222 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:58.592156 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:58.714036 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:58.713976 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:58.802537 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:58.802444 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:58.840586 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:58.840555 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-vldwk"] Jul 23 22:23:58.843402 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:58.843380 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vldwk" Jul 23 22:23:58.846529 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:58.846354 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 23 22:23:58.846841 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:58.846801 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 23 22:23:58.847398 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:58.847374 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-vzgxm\"" Jul 23 22:23:58.847507 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:58.847438 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 23 22:23:58.847668 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:58.847650 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 23 22:23:58.847938 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:58.847919 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 23 22:23:58.852384 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:58.852185 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-pq7w7"] Jul 23 22:23:58.854334 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:58.854314 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-pq7w7" Jul 23 22:23:58.858904 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:58.858865 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 23 22:23:58.865475 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:58.865361 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/17c7b23f-94c8-40a6-ae98-04f7e7c0e7ed-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-pq7w7\" (UID: \"17c7b23f-94c8-40a6-ae98-04f7e7c0e7ed\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-pq7w7" Jul 23 22:23:58.865475 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:58.865399 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qscfn\" (UniqueName: \"kubernetes.io/projected/fa281f11-d5c2-49d8-b184-50b1695fa84b-kube-api-access-qscfn\") pod \"openshift-state-metrics-79f6958cdf-vldwk\" (UID: \"fa281f11-d5c2-49d8-b184-50b1695fa84b\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vldwk" Jul 23 22:23:58.865475 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:58.865436 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa281f11-d5c2-49d8-b184-50b1695fa84b-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-vldwk\" (UID: \"fa281f11-d5c2-49d8-b184-50b1695fa84b\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vldwk" Jul 23 22:23:58.865475 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:58.865476 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa281f11-d5c2-49d8-b184-50b1695fa84b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-vldwk\" (UID: \"fa281f11-d5c2-49d8-b184-50b1695fa84b\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vldwk" Jul 23 22:23:58.865730 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:58.865502 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lj4nr\" (UniqueName: \"kubernetes.io/projected/17c7b23f-94c8-40a6-ae98-04f7e7c0e7ed-kube-api-access-lj4nr\") pod \"kube-state-metrics-56c5594674-pq7w7\" (UID: \"17c7b23f-94c8-40a6-ae98-04f7e7c0e7ed\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-pq7w7" Jul 23 22:23:58.865730 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:58.865528 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fa281f11-d5c2-49d8-b184-50b1695fa84b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-vldwk\" (UID: \"fa281f11-d5c2-49d8-b184-50b1695fa84b\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vldwk" Jul 23 22:23:58.865730 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:58.865560 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/17c7b23f-94c8-40a6-ae98-04f7e7c0e7ed-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-pq7w7\" (UID: \"17c7b23f-94c8-40a6-ae98-04f7e7c0e7ed\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-pq7w7" Jul 23 22:23:58.865730 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:58.865585 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/17c7b23f-94c8-40a6-ae98-04f7e7c0e7ed-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-pq7w7\" (UID: \"17c7b23f-94c8-40a6-ae98-04f7e7c0e7ed\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-pq7w7" Jul 23 22:23:58.865730 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:58.865611 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/17c7b23f-94c8-40a6-ae98-04f7e7c0e7ed-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-pq7w7\" (UID: \"17c7b23f-94c8-40a6-ae98-04f7e7c0e7ed\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-pq7w7" Jul 23 22:23:58.865730 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:58.865633 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/17c7b23f-94c8-40a6-ae98-04f7e7c0e7ed-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-pq7w7\" (UID: \"17c7b23f-94c8-40a6-ae98-04f7e7c0e7ed\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-pq7w7" Jul 23 22:23:58.866042 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:58.865728 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 23 22:23:58.866042 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:58.865820 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 23 22:23:58.866147 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:58.866046 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-82dhj\"" Jul 23 22:23:58.872412 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:58.872014 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-vldwk"] Jul 23 22:23:58.889666 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:58.889644 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-pq7w7"] Jul 23 22:23:58.890508 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:58.890004 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-4rsp4"] Jul 23 22:23:58.893043 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:58.892778 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4rsp4" Jul 23 22:23:58.896679 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:58.896482 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 23 22:23:58.897225 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:58.896923 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-9zrvx\"" Jul 23 22:23:58.898263 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:58.897895 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 23 22:23:58.898623 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:58.898474 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 23 22:23:58.920886 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:58.920843 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:58.965949 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:58.965885 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fa281f11-d5c2-49d8-b184-50b1695fa84b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-vldwk\" (UID: \"fa281f11-d5c2-49d8-b184-50b1695fa84b\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vldwk" Jul 23 22:23:58.965949 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:58.965921 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/17c7b23f-94c8-40a6-ae98-04f7e7c0e7ed-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-pq7w7\" (UID: \"17c7b23f-94c8-40a6-ae98-04f7e7c0e7ed\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-pq7w7" Jul 23 22:23:58.966777 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:58.966155 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/17c7b23f-94c8-40a6-ae98-04f7e7c0e7ed-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-pq7w7\" (UID: \"17c7b23f-94c8-40a6-ae98-04f7e7c0e7ed\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-pq7w7" Jul 23 22:23:58.966777 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:58.966204 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0a96eb6f-ba5b-42ac-805c-6e36094d07bf-root\") pod \"node-exporter-4rsp4\" (UID: \"0a96eb6f-ba5b-42ac-805c-6e36094d07bf\") " pod="openshift-monitoring/node-exporter-4rsp4" Jul 23 22:23:58.966777 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:58.966229 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4ztb\" (UniqueName: \"kubernetes.io/projected/0a96eb6f-ba5b-42ac-805c-6e36094d07bf-kube-api-access-h4ztb\") pod \"node-exporter-4rsp4\" (UID: \"0a96eb6f-ba5b-42ac-805c-6e36094d07bf\") " pod="openshift-monitoring/node-exporter-4rsp4" Jul 23 22:23:58.966777 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:58.966267 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/17c7b23f-94c8-40a6-ae98-04f7e7c0e7ed-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-pq7w7\" (UID: \"17c7b23f-94c8-40a6-ae98-04f7e7c0e7ed\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-pq7w7" Jul 23 22:23:58.966777 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:58.966298 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0a96eb6f-ba5b-42ac-805c-6e36094d07bf-node-exporter-tls\") pod \"node-exporter-4rsp4\" (UID: \"0a96eb6f-ba5b-42ac-805c-6e36094d07bf\") " pod="openshift-monitoring/node-exporter-4rsp4" Jul 23 22:23:58.966777 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:58.966326 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/17c7b23f-94c8-40a6-ae98-04f7e7c0e7ed-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-pq7w7\" (UID: \"17c7b23f-94c8-40a6-ae98-04f7e7c0e7ed\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-pq7w7" Jul 23 22:23:58.966777 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:58.966352 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0a96eb6f-ba5b-42ac-805c-6e36094d07bf-sys\") pod \"node-exporter-4rsp4\" (UID: \"0a96eb6f-ba5b-42ac-805c-6e36094d07bf\") " pod="openshift-monitoring/node-exporter-4rsp4" Jul 23 22:23:58.966777 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:58.966391 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a96eb6f-ba5b-42ac-805c-6e36094d07bf-metrics-client-ca\") pod \"node-exporter-4rsp4\" (UID: \"0a96eb6f-ba5b-42ac-805c-6e36094d07bf\") " pod="openshift-monitoring/node-exporter-4rsp4" Jul 23 22:23:58.966777 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:58.966426 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0a96eb6f-ba5b-42ac-805c-6e36094d07bf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4rsp4\" (UID: \"0a96eb6f-ba5b-42ac-805c-6e36094d07bf\") " pod="openshift-monitoring/node-exporter-4rsp4" Jul 23 22:23:58.966777 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:58.966453 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0a96eb6f-ba5b-42ac-805c-6e36094d07bf-node-exporter-accelerators-collector-config\") pod \"node-exporter-4rsp4\" (UID: \"0a96eb6f-ba5b-42ac-805c-6e36094d07bf\") " pod="openshift-monitoring/node-exporter-4rsp4" Jul 23 22:23:58.966777 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:58.966484 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0a96eb6f-ba5b-42ac-805c-6e36094d07bf-node-exporter-textfile\") pod \"node-exporter-4rsp4\" (UID: \"0a96eb6f-ba5b-42ac-805c-6e36094d07bf\") " pod="openshift-monitoring/node-exporter-4rsp4" Jul 23 22:23:58.966777 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:58.966530 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/17c7b23f-94c8-40a6-ae98-04f7e7c0e7ed-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-pq7w7\" (UID: \"17c7b23f-94c8-40a6-ae98-04f7e7c0e7ed\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-pq7w7" Jul 23 22:23:58.966777 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:58.966557 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qscfn\" (UniqueName: \"kubernetes.io/projected/fa281f11-d5c2-49d8-b184-50b1695fa84b-kube-api-access-qscfn\") pod \"openshift-state-metrics-79f6958cdf-vldwk\" (UID: \"fa281f11-d5c2-49d8-b184-50b1695fa84b\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vldwk" Jul 23 22:23:58.967494 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:58.966614 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa281f11-d5c2-49d8-b184-50b1695fa84b-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-vldwk\" (UID: \"fa281f11-d5c2-49d8-b184-50b1695fa84b\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vldwk" Jul 23 22:23:58.967494 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:58.966653 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0a96eb6f-ba5b-42ac-805c-6e36094d07bf-node-exporter-wtmp\") pod \"node-exporter-4rsp4\" (UID: \"0a96eb6f-ba5b-42ac-805c-6e36094d07bf\") " pod="openshift-monitoring/node-exporter-4rsp4" Jul 23 22:23:58.967494 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:58.966682 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa281f11-d5c2-49d8-b184-50b1695fa84b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-vldwk\" (UID: \"fa281f11-d5c2-49d8-b184-50b1695fa84b\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vldwk" Jul 23 22:23:58.967494 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:58.966711 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lj4nr\" (UniqueName: \"kubernetes.io/projected/17c7b23f-94c8-40a6-ae98-04f7e7c0e7ed-kube-api-access-lj4nr\") pod \"kube-state-metrics-56c5594674-pq7w7\" (UID: \"17c7b23f-94c8-40a6-ae98-04f7e7c0e7ed\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-pq7w7" Jul 23 22:23:58.967494 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:58.967162 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/17c7b23f-94c8-40a6-ae98-04f7e7c0e7ed-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-pq7w7\" (UID: \"17c7b23f-94c8-40a6-ae98-04f7e7c0e7ed\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-pq7w7" Jul 23 22:23:58.967494 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:58.967284 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/17c7b23f-94c8-40a6-ae98-04f7e7c0e7ed-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-pq7w7\" (UID: \"17c7b23f-94c8-40a6-ae98-04f7e7c0e7ed\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-pq7w7" Jul 23 22:23:58.967494 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:58.967390 2575 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 23 22:23:58.967494 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:23:58.967440 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa281f11-d5c2-49d8-b184-50b1695fa84b-openshift-state-metrics-tls podName:fa281f11-d5c2-49d8-b184-50b1695fa84b nodeName:}" failed. No retries permitted until 2026-07-23 22:23:59.467422543 +0000 UTC m=+67.187419796 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/fa281f11-d5c2-49d8-b184-50b1695fa84b-openshift-state-metrics-tls") pod "openshift-state-metrics-79f6958cdf-vldwk" (UID: "fa281f11-d5c2-49d8-b184-50b1695fa84b") : secret "openshift-state-metrics-tls" not found Jul 23 22:23:58.967877 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:58.967834 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa281f11-d5c2-49d8-b184-50b1695fa84b-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-vldwk\" (UID: \"fa281f11-d5c2-49d8-b184-50b1695fa84b\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vldwk" Jul 23 22:23:58.968319 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:58.968281 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/17c7b23f-94c8-40a6-ae98-04f7e7c0e7ed-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-pq7w7\" (UID: \"17c7b23f-94c8-40a6-ae98-04f7e7c0e7ed\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-pq7w7" Jul 23 22:23:58.969130 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:58.969085 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fa281f11-d5c2-49d8-b184-50b1695fa84b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-vldwk\" (UID: \"fa281f11-d5c2-49d8-b184-50b1695fa84b\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vldwk" Jul 23 22:23:58.970052 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:58.970000 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/17c7b23f-94c8-40a6-ae98-04f7e7c0e7ed-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-pq7w7\" (UID: \"17c7b23f-94c8-40a6-ae98-04f7e7c0e7ed\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-pq7w7" Jul 23 22:23:58.971281 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:58.971233 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/17c7b23f-94c8-40a6-ae98-04f7e7c0e7ed-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-pq7w7\" (UID: \"17c7b23f-94c8-40a6-ae98-04f7e7c0e7ed\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-pq7w7" Jul 23 22:23:58.982174 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:58.982121 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lj4nr\" (UniqueName: \"kubernetes.io/projected/17c7b23f-94c8-40a6-ae98-04f7e7c0e7ed-kube-api-access-lj4nr\") pod \"kube-state-metrics-56c5594674-pq7w7\" (UID: \"17c7b23f-94c8-40a6-ae98-04f7e7c0e7ed\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-pq7w7" Jul 23 22:23:58.983453 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:58.983429 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qscfn\" (UniqueName: \"kubernetes.io/projected/fa281f11-d5c2-49d8-b184-50b1695fa84b-kube-api-access-qscfn\") pod \"openshift-state-metrics-79f6958cdf-vldwk\" (UID: \"fa281f11-d5c2-49d8-b184-50b1695fa84b\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vldwk" Jul 23 22:23:58.997745 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:58.997706 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:59.067320 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:59.067268 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0a96eb6f-ba5b-42ac-805c-6e36094d07bf-root\") pod \"node-exporter-4rsp4\" (UID: \"0a96eb6f-ba5b-42ac-805c-6e36094d07bf\") " pod="openshift-monitoring/node-exporter-4rsp4" Jul 23 22:23:59.067398 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:59.067341 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4ztb\" (UniqueName: \"kubernetes.io/projected/0a96eb6f-ba5b-42ac-805c-6e36094d07bf-kube-api-access-h4ztb\") pod \"node-exporter-4rsp4\" (UID: \"0a96eb6f-ba5b-42ac-805c-6e36094d07bf\") " pod="openshift-monitoring/node-exporter-4rsp4" Jul 23 22:23:59.067398 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:59.067358 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0a96eb6f-ba5b-42ac-805c-6e36094d07bf-root\") pod \"node-exporter-4rsp4\" (UID: \"0a96eb6f-ba5b-42ac-805c-6e36094d07bf\") " pod="openshift-monitoring/node-exporter-4rsp4" Jul 23 22:23:59.067398 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:59.067377 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0a96eb6f-ba5b-42ac-805c-6e36094d07bf-node-exporter-tls\") pod \"node-exporter-4rsp4\" (UID: \"0a96eb6f-ba5b-42ac-805c-6e36094d07bf\") " pod="openshift-monitoring/node-exporter-4rsp4" Jul 23 22:23:59.067699 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:59.067672 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0a96eb6f-ba5b-42ac-805c-6e36094d07bf-sys\") pod \"node-exporter-4rsp4\" (UID: \"0a96eb6f-ba5b-42ac-805c-6e36094d07bf\") " pod="openshift-monitoring/node-exporter-4rsp4" Jul 23 22:23:59.067774 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:59.067712 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a96eb6f-ba5b-42ac-805c-6e36094d07bf-metrics-client-ca\") pod \"node-exporter-4rsp4\" (UID: \"0a96eb6f-ba5b-42ac-805c-6e36094d07bf\") " pod="openshift-monitoring/node-exporter-4rsp4" Jul 23 22:23:59.067774 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:59.067750 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0a96eb6f-ba5b-42ac-805c-6e36094d07bf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4rsp4\" (UID: \"0a96eb6f-ba5b-42ac-805c-6e36094d07bf\") " pod="openshift-monitoring/node-exporter-4rsp4" Jul 23 22:23:59.067774 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:59.067762 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0a96eb6f-ba5b-42ac-805c-6e36094d07bf-sys\") pod \"node-exporter-4rsp4\" (UID: \"0a96eb6f-ba5b-42ac-805c-6e36094d07bf\") " pod="openshift-monitoring/node-exporter-4rsp4" Jul 23 22:23:59.067918 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:59.067797 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0a96eb6f-ba5b-42ac-805c-6e36094d07bf-node-exporter-accelerators-collector-config\") pod \"node-exporter-4rsp4\" (UID: \"0a96eb6f-ba5b-42ac-805c-6e36094d07bf\") " pod="openshift-monitoring/node-exporter-4rsp4" Jul 23 22:23:59.067918 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:59.067832 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0a96eb6f-ba5b-42ac-805c-6e36094d07bf-node-exporter-textfile\") pod \"node-exporter-4rsp4\" (UID: \"0a96eb6f-ba5b-42ac-805c-6e36094d07bf\") " pod="openshift-monitoring/node-exporter-4rsp4" Jul 23 22:23:59.067918 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:59.067881 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0a96eb6f-ba5b-42ac-805c-6e36094d07bf-node-exporter-wtmp\") pod \"node-exporter-4rsp4\" (UID: \"0a96eb6f-ba5b-42ac-805c-6e36094d07bf\") " pod="openshift-monitoring/node-exporter-4rsp4" Jul 23 22:23:59.068086 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:59.068068 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0a96eb6f-ba5b-42ac-805c-6e36094d07bf-node-exporter-wtmp\") pod \"node-exporter-4rsp4\" (UID: \"0a96eb6f-ba5b-42ac-805c-6e36094d07bf\") " pod="openshift-monitoring/node-exporter-4rsp4" Jul 23 22:23:59.068420 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:59.068345 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a96eb6f-ba5b-42ac-805c-6e36094d07bf-metrics-client-ca\") pod \"node-exporter-4rsp4\" (UID: \"0a96eb6f-ba5b-42ac-805c-6e36094d07bf\") " pod="openshift-monitoring/node-exporter-4rsp4" Jul 23 22:23:59.068548 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:59.068528 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0a96eb6f-ba5b-42ac-805c-6e36094d07bf-node-exporter-textfile\") pod \"node-exporter-4rsp4\" (UID: \"0a96eb6f-ba5b-42ac-805c-6e36094d07bf\") " pod="openshift-monitoring/node-exporter-4rsp4" Jul 23 22:23:59.068721 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:59.068696 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0a96eb6f-ba5b-42ac-805c-6e36094d07bf-node-exporter-accelerators-collector-config\") pod \"node-exporter-4rsp4\" (UID: \"0a96eb6f-ba5b-42ac-805c-6e36094d07bf\") " pod="openshift-monitoring/node-exporter-4rsp4" Jul 23 22:23:59.070722 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:59.070582 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0a96eb6f-ba5b-42ac-805c-6e36094d07bf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4rsp4\" (UID: \"0a96eb6f-ba5b-42ac-805c-6e36094d07bf\") " pod="openshift-monitoring/node-exporter-4rsp4" Jul 23 22:23:59.070722 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:59.070705 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0a96eb6f-ba5b-42ac-805c-6e36094d07bf-node-exporter-tls\") pod \"node-exporter-4rsp4\" (UID: \"0a96eb6f-ba5b-42ac-805c-6e36094d07bf\") " pod="openshift-monitoring/node-exporter-4rsp4" Jul 23 22:23:59.076612 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:59.076568 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4ztb\" (UniqueName: \"kubernetes.io/projected/0a96eb6f-ba5b-42ac-805c-6e36094d07bf-kube-api-access-h4ztb\") pod \"node-exporter-4rsp4\" (UID: \"0a96eb6f-ba5b-42ac-805c-6e36094d07bf\") " pod="openshift-monitoring/node-exporter-4rsp4" Jul 23 22:23:59.095225 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:59.095193 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:59.133171 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:59.133138 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fd6hg" event={"ID":"fc3410ae-ba34-41dc-b992-c51a7bd26fd4","Type":"ContainerStarted","Data":"a78ae6cf20093ec80d1272e838f25bbc5078b346c11f88bf6f1dc79bc0d2f426"} Jul 23 22:23:59.133292 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:59.133207 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fd6hg" event={"ID":"fc3410ae-ba34-41dc-b992-c51a7bd26fd4","Type":"ContainerStarted","Data":"eec75c7fb7985c752003fbe7d9265f232b13bd96248203300549b035503a0494"} Jul 23 22:23:59.151064 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:59.151002 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-fd6hg" podStartSLOduration=66.157603407 podStartE2EDuration="1m7.15098686s" totalImagesPullingTime="993.383453ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 22:22:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:23:59.149682845 +0000 UTC m=+66.869680106" watchObservedRunningTime="2026-07-23 22:23:59.15098686 +0000 UTC m=+66.870984122" Jul 23 22:23:59.167175 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:59.167155 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-pq7w7" Jul 23 22:23:59.199400 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:59.199328 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:59.209966 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:59.209764 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4rsp4" Jul 23 22:23:59.221839 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:23:59.221809 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a96eb6f_ba5b_42ac_805c_6e36094d07bf.slice/crio-cbdbd1cf81a53fc2655c9c71c57faf13bccddd2bf979e18d7bee858aeb67b440 WatchSource:0}: Error finding container cbdbd1cf81a53fc2655c9c71c57faf13bccddd2bf979e18d7bee858aeb67b440: Status 404 returned error can't find the container with id cbdbd1cf81a53fc2655c9c71c57faf13bccddd2bf979e18d7bee858aeb67b440 Jul 23 22:23:59.307933 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:59.307900 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:59.323337 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:59.323255 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-pq7w7"] Jul 23 22:23:59.326580 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:23:59.326519 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17c7b23f_94c8_40a6_ae98_04f7e7c0e7ed.slice/crio-8b887305d10dbc24d400713bddacf46c07561ceda8d8b3e0990d864ca0c62cc4 WatchSource:0}: Error finding container 8b887305d10dbc24d400713bddacf46c07561ceda8d8b3e0990d864ca0c62cc4: Status 404 returned error can't find the container with id 8b887305d10dbc24d400713bddacf46c07561ceda8d8b3e0990d864ca0c62cc4 Jul 23 22:23:59.396138 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:59.396109 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:59.471726 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:59.471696 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa281f11-d5c2-49d8-b184-50b1695fa84b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-vldwk\" (UID: \"fa281f11-d5c2-49d8-b184-50b1695fa84b\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vldwk" Jul 23 22:23:59.474616 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:59.474590 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa281f11-d5c2-49d8-b184-50b1695fa84b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-vldwk\" (UID: \"fa281f11-d5c2-49d8-b184-50b1695fa84b\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vldwk" Jul 23 22:23:59.690462 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:59.690416 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:59.756007 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:59.755977 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vldwk" Jul 23 22:23:59.790276 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:59.790241 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:59.870061 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:59.869958 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:59.875963 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:59.874364 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 23 22:23:59.890175 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:59.888400 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:23:59.894342 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:59.893433 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 23 22:23:59.894342 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:59.893761 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 23 22:23:59.894342 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:59.894002 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 23 22:23:59.896600 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:59.894747 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-vv7xn\"" Jul 23 22:23:59.896600 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:59.894963 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 23 22:23:59.896600 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:59.895166 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 23 22:23:59.896600 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:59.895406 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 23 22:23:59.896600 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:59.895600 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 23 22:23:59.896600 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:59.895914 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 23 22:23:59.899912 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:59.899725 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 23 22:23:59.905250 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:59.905107 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 23 22:23:59.949672 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:59.948460 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-vldwk"] Jul 23 22:23:59.952176 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:59.951898 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:23:59.975723 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:59.975696 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/19824801-1c49-4255-ac21-bd571b9a417b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"19824801-1c49-4255-ac21-bd571b9a417b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:23:59.975843 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:59.975741 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdxvt\" (UniqueName: \"kubernetes.io/projected/19824801-1c49-4255-ac21-bd571b9a417b-kube-api-access-sdxvt\") pod \"alertmanager-main-0\" (UID: \"19824801-1c49-4255-ac21-bd571b9a417b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:23:59.975843 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:59.975773 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/19824801-1c49-4255-ac21-bd571b9a417b-config-volume\") pod \"alertmanager-main-0\" (UID: \"19824801-1c49-4255-ac21-bd571b9a417b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:23:59.975843 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:59.975800 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/19824801-1c49-4255-ac21-bd571b9a417b-config-out\") pod \"alertmanager-main-0\" (UID: \"19824801-1c49-4255-ac21-bd571b9a417b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:23:59.975843 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:59.975824 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/19824801-1c49-4255-ac21-bd571b9a417b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"19824801-1c49-4255-ac21-bd571b9a417b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:23:59.976067 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:59.975848 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/19824801-1c49-4255-ac21-bd571b9a417b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"19824801-1c49-4255-ac21-bd571b9a417b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:23:59.976067 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:59.975879 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/19824801-1c49-4255-ac21-bd571b9a417b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"19824801-1c49-4255-ac21-bd571b9a417b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:23:59.976067 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:59.975927 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/19824801-1c49-4255-ac21-bd571b9a417b-web-config\") pod \"alertmanager-main-0\" (UID: \"19824801-1c49-4255-ac21-bd571b9a417b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:23:59.976067 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:59.975948 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/19824801-1c49-4255-ac21-bd571b9a417b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"19824801-1c49-4255-ac21-bd571b9a417b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:23:59.976067 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:59.975976 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/19824801-1c49-4255-ac21-bd571b9a417b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"19824801-1c49-4255-ac21-bd571b9a417b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:23:59.976067 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:59.976001 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/19824801-1c49-4255-ac21-bd571b9a417b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"19824801-1c49-4255-ac21-bd571b9a417b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:23:59.976067 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:59.976051 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/19824801-1c49-4255-ac21-bd571b9a417b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"19824801-1c49-4255-ac21-bd571b9a417b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:23:59.976428 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:23:59.976075 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/19824801-1c49-4255-ac21-bd571b9a417b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"19824801-1c49-4255-ac21-bd571b9a417b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:24:00.077987 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:00.077142 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/19824801-1c49-4255-ac21-bd571b9a417b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"19824801-1c49-4255-ac21-bd571b9a417b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:24:00.077987 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:00.077185 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdxvt\" (UniqueName: \"kubernetes.io/projected/19824801-1c49-4255-ac21-bd571b9a417b-kube-api-access-sdxvt\") pod \"alertmanager-main-0\" (UID: \"19824801-1c49-4255-ac21-bd571b9a417b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:24:00.077987 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:00.077220 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/19824801-1c49-4255-ac21-bd571b9a417b-config-volume\") pod \"alertmanager-main-0\" (UID: \"19824801-1c49-4255-ac21-bd571b9a417b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:24:00.077987 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:00.077249 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/19824801-1c49-4255-ac21-bd571b9a417b-config-out\") pod \"alertmanager-main-0\" (UID: \"19824801-1c49-4255-ac21-bd571b9a417b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:24:00.077987 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:00.077272 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/19824801-1c49-4255-ac21-bd571b9a417b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"19824801-1c49-4255-ac21-bd571b9a417b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:24:00.077987 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:00.077298 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/19824801-1c49-4255-ac21-bd571b9a417b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"19824801-1c49-4255-ac21-bd571b9a417b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:24:00.077987 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:00.077356 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/19824801-1c49-4255-ac21-bd571b9a417b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"19824801-1c49-4255-ac21-bd571b9a417b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:24:00.077987 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:00.077411 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/19824801-1c49-4255-ac21-bd571b9a417b-web-config\") pod \"alertmanager-main-0\" (UID: \"19824801-1c49-4255-ac21-bd571b9a417b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:24:00.077987 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:00.077435 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/19824801-1c49-4255-ac21-bd571b9a417b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"19824801-1c49-4255-ac21-bd571b9a417b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:24:00.077987 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:00.077476 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/19824801-1c49-4255-ac21-bd571b9a417b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"19824801-1c49-4255-ac21-bd571b9a417b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:24:00.077987 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:00.077504 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/19824801-1c49-4255-ac21-bd571b9a417b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"19824801-1c49-4255-ac21-bd571b9a417b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:24:00.077987 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:00.077535 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/19824801-1c49-4255-ac21-bd571b9a417b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"19824801-1c49-4255-ac21-bd571b9a417b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:24:00.077987 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:00.077558 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/19824801-1c49-4255-ac21-bd571b9a417b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"19824801-1c49-4255-ac21-bd571b9a417b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:24:00.078967 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:00.078940 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/19824801-1c49-4255-ac21-bd571b9a417b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"19824801-1c49-4255-ac21-bd571b9a417b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:24:00.079073 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:24:00.079049 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/19824801-1c49-4255-ac21-bd571b9a417b-alertmanager-trusted-ca-bundle podName:19824801-1c49-4255-ac21-bd571b9a417b nodeName:}" failed. No retries permitted until 2026-07-23 22:24:00.579014586 +0000 UTC m=+68.299011857 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/19824801-1c49-4255-ac21-bd571b9a417b-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "19824801-1c49-4255-ac21-bd571b9a417b") : configmap references non-existent config key: ca-bundle.crt Jul 23 22:24:00.080223 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:00.079621 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/19824801-1c49-4255-ac21-bd571b9a417b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"19824801-1c49-4255-ac21-bd571b9a417b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:24:00.080654 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:00.080632 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/19824801-1c49-4255-ac21-bd571b9a417b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"19824801-1c49-4255-ac21-bd571b9a417b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:24:00.081767 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:00.081722 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/19824801-1c49-4255-ac21-bd571b9a417b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"19824801-1c49-4255-ac21-bd571b9a417b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:24:00.083376 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:00.083350 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/19824801-1c49-4255-ac21-bd571b9a417b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"19824801-1c49-4255-ac21-bd571b9a417b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:24:00.083516 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:00.083422 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/19824801-1c49-4255-ac21-bd571b9a417b-config-volume\") pod \"alertmanager-main-0\" (UID: \"19824801-1c49-4255-ac21-bd571b9a417b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:24:00.083516 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:00.083503 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/19824801-1c49-4255-ac21-bd571b9a417b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"19824801-1c49-4255-ac21-bd571b9a417b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:24:00.083676 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:00.083631 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/19824801-1c49-4255-ac21-bd571b9a417b-config-out\") pod \"alertmanager-main-0\" (UID: \"19824801-1c49-4255-ac21-bd571b9a417b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:24:00.084230 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:00.083890 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/19824801-1c49-4255-ac21-bd571b9a417b-web-config\") pod \"alertmanager-main-0\" (UID: \"19824801-1c49-4255-ac21-bd571b9a417b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:24:00.084935 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:00.084904 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/19824801-1c49-4255-ac21-bd571b9a417b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"19824801-1c49-4255-ac21-bd571b9a417b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:24:00.085364 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:00.085315 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/19824801-1c49-4255-ac21-bd571b9a417b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"19824801-1c49-4255-ac21-bd571b9a417b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:24:00.091418 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:00.091397 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdxvt\" (UniqueName: \"kubernetes.io/projected/19824801-1c49-4255-ac21-bd571b9a417b-kube-api-access-sdxvt\") pod \"alertmanager-main-0\" (UID: \"19824801-1c49-4255-ac21-bd571b9a417b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:24:00.140984 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:00.140874 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vldwk" event={"ID":"fa281f11-d5c2-49d8-b184-50b1695fa84b","Type":"ContainerStarted","Data":"f26ce838a03fe3ac321027901bb73e0ebf576c1276aabf60d3f586389add51ba"} Jul 23 22:24:00.140984 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:00.140946 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vldwk" event={"ID":"fa281f11-d5c2-49d8-b184-50b1695fa84b","Type":"ContainerStarted","Data":"1cec5ed98b924ff96532ea505be99f527f8c6e09643e03b75421b6cfe7c0dcff"} Jul 23 22:24:00.142883 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:00.142809 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4rsp4" event={"ID":"0a96eb6f-ba5b-42ac-805c-6e36094d07bf","Type":"ContainerStarted","Data":"cbdbd1cf81a53fc2655c9c71c57faf13bccddd2bf979e18d7bee858aeb67b440"} Jul 23 22:24:00.145007 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:00.144979 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-pq7w7" event={"ID":"17c7b23f-94c8-40a6-ae98-04f7e7c0e7ed","Type":"ContainerStarted","Data":"8b887305d10dbc24d400713bddacf46c07561ceda8d8b3e0990d864ca0c62cc4"} Jul 23 22:24:00.491213 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:00.491165 2575 patch_prober.go:28] interesting pod/image-registry-56f57fb769-nnwh2 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 23 22:24:00.491363 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:00.491232 2575 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-56f57fb769-nnwh2" podUID="bd489273-20d6-4e66-98ae-9a3616fac8e1" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 23 22:24:00.583223 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:00.583193 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/19824801-1c49-4255-ac21-bd571b9a417b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"19824801-1c49-4255-ac21-bd571b9a417b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:24:00.584104 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:00.584072 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/19824801-1c49-4255-ac21-bd571b9a417b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"19824801-1c49-4255-ac21-bd571b9a417b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:24:00.806436 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:00.806368 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:24:00.923651 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:00.923614 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:24:01.027541 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:01.027513 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:24:01.791264 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:01.791237 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:24:01.897125 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:01.897087 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:24:01.965852 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:01.965823 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:24:02.071817 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:02.071739 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-56f57fb769-nnwh2" Jul 23 22:24:02.195190 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:02.195156 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:24:02.297660 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:02.297630 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:24:02.388671 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:02.388596 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:24:03.281512 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:03.281430 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:24:03.309861 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:03.309836 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 23 22:24:03.311597 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:24:03.311529 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19824801_1c49_4255_ac21_bd571b9a417b.slice/crio-5777ef1bd12b22f1f8db0db0473527f0f007a662d12923ac9bc5e6e532075424 WatchSource:0}: Error finding container 5777ef1bd12b22f1f8db0db0473527f0f007a662d12923ac9bc5e6e532075424: Status 404 returned error can't find the container with id 5777ef1bd12b22f1f8db0db0473527f0f007a662d12923ac9bc5e6e532075424 Jul 23 22:24:03.394004 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:03.393926 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:24:03.509973 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:03.509945 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:24:03.604012 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:03.603983 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:24:03.926889 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:03.926860 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:24:04.163417 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:04.163377 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7c5dff46bc-mxk6c"] Jul 23 22:24:04.165824 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:04.165788 2575 generic.go:356] "Generic (PLEG): container finished" podID="0a96eb6f-ba5b-42ac-805c-6e36094d07bf" containerID="641e32eb56f53bd3e60a794d42b0d8010bd0fdc505b0ca9f403c82b9c21cf7d7" exitCode=0 Jul 23 22:24:04.166080 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:04.166011 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-pl657" event={"ID":"81890460-aa07-4749-aadd-909c876b9244","Type":"ContainerStarted","Data":"6f6dd35941bfd8870e83c121b5e01b1f341817d82fd8fef366b4da3773afb39f"} Jul 23 22:24:04.166080 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:04.166065 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4rsp4" event={"ID":"0a96eb6f-ba5b-42ac-805c-6e36094d07bf","Type":"ContainerDied","Data":"641e32eb56f53bd3e60a794d42b0d8010bd0fdc505b0ca9f403c82b9c21cf7d7"} Jul 23 22:24:04.166262 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:04.166112 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7c5dff46bc-mxk6c" Jul 23 22:24:04.168393 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:04.168367 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-pq7w7" event={"ID":"17c7b23f-94c8-40a6-ae98-04f7e7c0e7ed","Type":"ContainerStarted","Data":"fd3670b44e57a4740a2c8256ca8e5e754ee67ccc00502eeb2228683ad3a305a5"} Jul 23 22:24:04.168501 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:04.168428 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-pq7w7" event={"ID":"17c7b23f-94c8-40a6-ae98-04f7e7c0e7ed","Type":"ContainerStarted","Data":"e2c38cb58e3f016b074fe3a181c1bab59c69ade1bb4fce7afd8dd361e388ad97"} Jul 23 22:24:04.168501 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:04.168457 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-pq7w7" event={"ID":"17c7b23f-94c8-40a6-ae98-04f7e7c0e7ed","Type":"ContainerStarted","Data":"c0b96eb34929b9f6b18b2327cfc4814bf191b00bf67e23c017537c80d661c5bb"} Jul 23 22:24:04.170343 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:04.170278 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 23 22:24:04.170485 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:04.170382 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 23 22:24:04.170551 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:04.170478 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 23 22:24:04.171010 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:04.170946 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 23 22:24:04.171293 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:04.171277 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 23 22:24:04.171556 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:04.171538 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-n2nmt\"" Jul 23 22:24:04.171646 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:04.171612 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ks6hk" event={"ID":"2d81f7cf-acbc-4389-b9fb-e621c3c060d4","Type":"ContainerStarted","Data":"770b8736a025c655d244c86ed52ad4da7e8fb4abf0be7fb700dffc266676d047"} Jul 23 22:24:04.172157 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:04.172135 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-ks6hk" Jul 23 22:24:04.176088 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:04.176065 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"19824801-1c49-4255-ac21-bd571b9a417b","Type":"ContainerStarted","Data":"5777ef1bd12b22f1f8db0db0473527f0f007a662d12923ac9bc5e6e532075424"} Jul 23 22:24:04.178557 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:04.178501 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vldwk" event={"ID":"fa281f11-d5c2-49d8-b184-50b1695fa84b","Type":"ContainerStarted","Data":"1b8972807de4e0ded976ae9426e99cd13a88097fb6ea7f0cedb45111b5e03e8c"} Jul 23 22:24:04.179724 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:04.179705 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 23 22:24:04.192571 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:04.192549 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7c5dff46bc-mxk6c"] Jul 23 22:24:04.195095 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:04.195053 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-pl657" podStartSLOduration=66.909930258 podStartE2EDuration="1m12.195039173s" totalImagesPullingTime="5.285108915s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 22:22:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:24:04.193774717 +0000 UTC m=+71.913771976" watchObservedRunningTime="2026-07-23 22:24:04.195039173 +0000 UTC m=+71.915036430" Jul 23 22:24:04.213929 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:04.213909 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f19d86d6-2a2f-4948-beb2-0bae1288b635-secret-telemeter-client\") pod \"telemeter-client-7c5dff46bc-mxk6c\" (UID: \"f19d86d6-2a2f-4948-beb2-0bae1288b635\") " pod="openshift-monitoring/telemeter-client-7c5dff46bc-mxk6c" Jul 23 22:24:04.214062 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:04.214044 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xl7jv\" (UniqueName: \"kubernetes.io/projected/f19d86d6-2a2f-4948-beb2-0bae1288b635-kube-api-access-xl7jv\") pod \"telemeter-client-7c5dff46bc-mxk6c\" (UID: \"f19d86d6-2a2f-4948-beb2-0bae1288b635\") " pod="openshift-monitoring/telemeter-client-7c5dff46bc-mxk6c" Jul 23 22:24:04.214123 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:04.214104 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f19d86d6-2a2f-4948-beb2-0bae1288b635-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7c5dff46bc-mxk6c\" (UID: \"f19d86d6-2a2f-4948-beb2-0bae1288b635\") " pod="openshift-monitoring/telemeter-client-7c5dff46bc-mxk6c" Jul 23 22:24:04.214498 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:04.214472 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f19d86d6-2a2f-4948-beb2-0bae1288b635-telemeter-client-tls\") pod \"telemeter-client-7c5dff46bc-mxk6c\" (UID: \"f19d86d6-2a2f-4948-beb2-0bae1288b635\") " pod="openshift-monitoring/telemeter-client-7c5dff46bc-mxk6c" Jul 23 22:24:04.214575 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:04.214512 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f19d86d6-2a2f-4948-beb2-0bae1288b635-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7c5dff46bc-mxk6c\" (UID: \"f19d86d6-2a2f-4948-beb2-0bae1288b635\") " pod="openshift-monitoring/telemeter-client-7c5dff46bc-mxk6c" Jul 23 22:24:04.214575 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:04.214548 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f19d86d6-2a2f-4948-beb2-0bae1288b635-federate-client-tls\") pod \"telemeter-client-7c5dff46bc-mxk6c\" (UID: \"f19d86d6-2a2f-4948-beb2-0bae1288b635\") " pod="openshift-monitoring/telemeter-client-7c5dff46bc-mxk6c" Jul 23 22:24:04.214669 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:04.214577 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f19d86d6-2a2f-4948-beb2-0bae1288b635-serving-certs-ca-bundle\") pod \"telemeter-client-7c5dff46bc-mxk6c\" (UID: \"f19d86d6-2a2f-4948-beb2-0bae1288b635\") " pod="openshift-monitoring/telemeter-client-7c5dff46bc-mxk6c" Jul 23 22:24:04.214669 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:04.214600 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f19d86d6-2a2f-4948-beb2-0bae1288b635-metrics-client-ca\") pod \"telemeter-client-7c5dff46bc-mxk6c\" (UID: \"f19d86d6-2a2f-4948-beb2-0bae1288b635\") " pod="openshift-monitoring/telemeter-client-7c5dff46bc-mxk6c" Jul 23 22:24:04.218874 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:04.218839 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-ks6hk" podStartSLOduration=66.982811844 podStartE2EDuration="1m12.218826932s" totalImagesPullingTime="5.236015088s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 22:22:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:24:04.218476979 +0000 UTC m=+71.938474241" watchObservedRunningTime="2026-07-23 22:24:04.218826932 +0000 UTC m=+71.938824192" Jul 23 22:24:04.312186 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:04.312137 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56c5594674-pq7w7" podStartSLOduration=2.500191157 podStartE2EDuration="6.312121622s" totalImagesPullingTime="3.811930465s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 22:23:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:24:04.311685723 +0000 UTC m=+72.031682982" watchObservedRunningTime="2026-07-23 22:24:04.312121622 +0000 UTC m=+72.032118881" Jul 23 22:24:04.314917 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:04.314893 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f19d86d6-2a2f-4948-beb2-0bae1288b635-secret-telemeter-client\") pod \"telemeter-client-7c5dff46bc-mxk6c\" (UID: \"f19d86d6-2a2f-4948-beb2-0bae1288b635\") " pod="openshift-monitoring/telemeter-client-7c5dff46bc-mxk6c" Jul 23 22:24:04.315047 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:04.314929 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xl7jv\" (UniqueName: \"kubernetes.io/projected/f19d86d6-2a2f-4948-beb2-0bae1288b635-kube-api-access-xl7jv\") pod \"telemeter-client-7c5dff46bc-mxk6c\" (UID: \"f19d86d6-2a2f-4948-beb2-0bae1288b635\") " pod="openshift-monitoring/telemeter-client-7c5dff46bc-mxk6c" Jul 23 22:24:04.315047 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:04.314950 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f19d86d6-2a2f-4948-beb2-0bae1288b635-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7c5dff46bc-mxk6c\" (UID: \"f19d86d6-2a2f-4948-beb2-0bae1288b635\") " pod="openshift-monitoring/telemeter-client-7c5dff46bc-mxk6c" Jul 23 22:24:04.315047 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:04.315008 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f19d86d6-2a2f-4948-beb2-0bae1288b635-telemeter-client-tls\") pod \"telemeter-client-7c5dff46bc-mxk6c\" (UID: \"f19d86d6-2a2f-4948-beb2-0bae1288b635\") " pod="openshift-monitoring/telemeter-client-7c5dff46bc-mxk6c" Jul 23 22:24:04.315217 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:04.315070 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f19d86d6-2a2f-4948-beb2-0bae1288b635-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7c5dff46bc-mxk6c\" (UID: \"f19d86d6-2a2f-4948-beb2-0bae1288b635\") " pod="openshift-monitoring/telemeter-client-7c5dff46bc-mxk6c" Jul 23 22:24:04.315217 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:04.315107 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f19d86d6-2a2f-4948-beb2-0bae1288b635-federate-client-tls\") pod \"telemeter-client-7c5dff46bc-mxk6c\" (UID: \"f19d86d6-2a2f-4948-beb2-0bae1288b635\") " pod="openshift-monitoring/telemeter-client-7c5dff46bc-mxk6c" Jul 23 22:24:04.315217 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:04.315136 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f19d86d6-2a2f-4948-beb2-0bae1288b635-serving-certs-ca-bundle\") pod \"telemeter-client-7c5dff46bc-mxk6c\" (UID: \"f19d86d6-2a2f-4948-beb2-0bae1288b635\") " pod="openshift-monitoring/telemeter-client-7c5dff46bc-mxk6c" Jul 23 22:24:04.315217 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:04.315163 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f19d86d6-2a2f-4948-beb2-0bae1288b635-metrics-client-ca\") pod \"telemeter-client-7c5dff46bc-mxk6c\" (UID: \"f19d86d6-2a2f-4948-beb2-0bae1288b635\") " pod="openshift-monitoring/telemeter-client-7c5dff46bc-mxk6c" Jul 23 22:24:04.315927 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:04.315862 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f19d86d6-2a2f-4948-beb2-0bae1288b635-metrics-client-ca\") pod \"telemeter-client-7c5dff46bc-mxk6c\" (UID: \"f19d86d6-2a2f-4948-beb2-0bae1288b635\") " pod="openshift-monitoring/telemeter-client-7c5dff46bc-mxk6c" Jul 23 22:24:04.316489 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:04.316462 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f19d86d6-2a2f-4948-beb2-0bae1288b635-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7c5dff46bc-mxk6c\" (UID: \"f19d86d6-2a2f-4948-beb2-0bae1288b635\") " pod="openshift-monitoring/telemeter-client-7c5dff46bc-mxk6c" Jul 23 22:24:04.316653 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:04.316624 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f19d86d6-2a2f-4948-beb2-0bae1288b635-serving-certs-ca-bundle\") pod \"telemeter-client-7c5dff46bc-mxk6c\" (UID: \"f19d86d6-2a2f-4948-beb2-0bae1288b635\") " pod="openshift-monitoring/telemeter-client-7c5dff46bc-mxk6c" Jul 23 22:24:04.317797 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:04.317773 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f19d86d6-2a2f-4948-beb2-0bae1288b635-telemeter-client-tls\") pod \"telemeter-client-7c5dff46bc-mxk6c\" (UID: \"f19d86d6-2a2f-4948-beb2-0bae1288b635\") " pod="openshift-monitoring/telemeter-client-7c5dff46bc-mxk6c" Jul 23 22:24:04.317910 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:04.317831 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f19d86d6-2a2f-4948-beb2-0bae1288b635-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7c5dff46bc-mxk6c\" (UID: \"f19d86d6-2a2f-4948-beb2-0bae1288b635\") " pod="openshift-monitoring/telemeter-client-7c5dff46bc-mxk6c" Jul 23 22:24:04.318068 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:04.318043 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f19d86d6-2a2f-4948-beb2-0bae1288b635-secret-telemeter-client\") pod \"telemeter-client-7c5dff46bc-mxk6c\" (UID: \"f19d86d6-2a2f-4948-beb2-0bae1288b635\") " pod="openshift-monitoring/telemeter-client-7c5dff46bc-mxk6c" Jul 23 22:24:04.318068 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:04.318060 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f19d86d6-2a2f-4948-beb2-0bae1288b635-federate-client-tls\") pod \"telemeter-client-7c5dff46bc-mxk6c\" (UID: \"f19d86d6-2a2f-4948-beb2-0bae1288b635\") " pod="openshift-monitoring/telemeter-client-7c5dff46bc-mxk6c" Jul 23 22:24:04.338165 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:04.338144 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xl7jv\" (UniqueName: \"kubernetes.io/projected/f19d86d6-2a2f-4948-beb2-0bae1288b635-kube-api-access-xl7jv\") pod \"telemeter-client-7c5dff46bc-mxk6c\" (UID: \"f19d86d6-2a2f-4948-beb2-0bae1288b635\") " pod="openshift-monitoring/telemeter-client-7c5dff46bc-mxk6c" Jul 23 22:24:04.479106 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:04.479043 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7c5dff46bc-mxk6c" Jul 23 22:24:04.656753 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:04.656731 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7c5dff46bc-mxk6c"] Jul 23 22:24:04.659983 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:24:04.659957 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf19d86d6_2a2f_4948_beb2_0bae1288b635.slice/crio-903b63ba0b8314bc72938ed5fefe56aba32197bb6c444d174f541860a39a8acf WatchSource:0}: Error finding container 903b63ba0b8314bc72938ed5fefe56aba32197bb6c444d174f541860a39a8acf: Status 404 returned error can't find the container with id 903b63ba0b8314bc72938ed5fefe56aba32197bb6c444d174f541860a39a8acf Jul 23 22:24:05.085802 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:05.085763 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:24:05.183935 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:05.183907 2575 generic.go:356] "Generic (PLEG): container finished" podID="19824801-1c49-4255-ac21-bd571b9a417b" containerID="6cd502007a6f156047ccc586a9181332ee48bf66b712016130fe2f27e056e998" exitCode=0 Jul 23 22:24:05.184147 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:05.183998 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"19824801-1c49-4255-ac21-bd571b9a417b","Type":"ContainerDied","Data":"6cd502007a6f156047ccc586a9181332ee48bf66b712016130fe2f27e056e998"} Jul 23 22:24:05.186618 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:05.186594 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vldwk" event={"ID":"fa281f11-d5c2-49d8-b184-50b1695fa84b","Type":"ContainerStarted","Data":"d4c10e64e6b7895accdb5e9c9811ee5d154f32823f57aaf7d8a95e777c670759"} Jul 23 22:24:05.188115 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:05.188051 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7c5dff46bc-mxk6c" event={"ID":"f19d86d6-2a2f-4948-beb2-0bae1288b635","Type":"ContainerStarted","Data":"903b63ba0b8314bc72938ed5fefe56aba32197bb6c444d174f541860a39a8acf"} Jul 23 22:24:05.190527 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:05.190502 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4rsp4" event={"ID":"0a96eb6f-ba5b-42ac-805c-6e36094d07bf","Type":"ContainerStarted","Data":"8cc01fd2eaaaa7be97efa37870639eff667f1740e2cdccfd71760311cc23ac13"} Jul 23 22:24:05.190612 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:05.190557 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4rsp4" event={"ID":"0a96eb6f-ba5b-42ac-805c-6e36094d07bf","Type":"ContainerStarted","Data":"59afd0656c9b9c074ef25e335dbe2f9359078d710a057d617c346bcb72f4bbb3"} Jul 23 22:24:05.309556 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:05.309514 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-4rsp4" podStartSLOduration=3.297579577 podStartE2EDuration="7.309501903s" totalImagesPullingTime="3.915783103s" totalInitContainerRuntime="96.139223ms" isStatefulPod=true podCreationTimestamp="2026-07-23 22:23:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:24:05.309331979 +0000 UTC m=+73.029329242" watchObservedRunningTime="2026-07-23 22:24:05.309501903 +0000 UTC m=+73.029499202" Jul 23 22:24:05.344063 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:05.343844 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vldwk" podStartSLOduration=6.077955995 podStartE2EDuration="7.343826272s" totalImagesPullingTime="1.265870277s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 22:23:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:24:05.343431159 +0000 UTC m=+73.063428419" watchObservedRunningTime="2026-07-23 22:24:05.343826272 +0000 UTC m=+73.063823533" Jul 23 22:24:05.522075 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:05.522040 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:24:05.603683 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:05.603616 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:24:06.197129 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:06.197095 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7c5dff46bc-mxk6c" event={"ID":"f19d86d6-2a2f-4948-beb2-0bae1288b635","Type":"ContainerStarted","Data":"fe3f7d7e96e2a05fe9150b7f4b546bd7760f635b105baf2ee75d100e4955b003"} Jul 23 22:24:07.122770 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:07.122713 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:24:07.191619 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:07.191588 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:24:07.204571 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:07.204542 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"19824801-1c49-4255-ac21-bd571b9a417b","Type":"ContainerStarted","Data":"bbd54e83ca5a6b97fdec81a159d847d7a770b0e60ae749d84b526c0c8bd4e0f0"} Jul 23 22:24:07.204747 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:07.204604 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"19824801-1c49-4255-ac21-bd571b9a417b","Type":"ContainerStarted","Data":"19508bf48dc4ccefe7a293ff9621ed25b2aa84330e4a54550c6036f517840c97"} Jul 23 22:24:07.204747 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:07.204645 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"19824801-1c49-4255-ac21-bd571b9a417b","Type":"ContainerStarted","Data":"37b47e098ff0d4576bd3aadfb915ed80e478be92088e3ca0ba57a5d19e8f9a36"} Jul 23 22:24:07.204747 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:07.204679 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"19824801-1c49-4255-ac21-bd571b9a417b","Type":"ContainerStarted","Data":"fc80bc6f422fee4aa07d4601efcf5df6954e9c267a1242ecd955e08565b5212c"} Jul 23 22:24:07.204747 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:07.204708 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"19824801-1c49-4255-ac21-bd571b9a417b","Type":"ContainerStarted","Data":"aff6789cd26323d86d05b2c2c72afccc1c16031d267bb709864b0f8f40c700e9"} Jul 23 22:24:07.211892 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:07.211329 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7c5dff46bc-mxk6c" event={"ID":"f19d86d6-2a2f-4948-beb2-0bae1288b635","Type":"ContainerStarted","Data":"3d8e9c8184a3176b773df370900df53871830202744e83915138ab9a88cd0b2d"} Jul 23 22:24:07.211892 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:07.211709 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7c5dff46bc-mxk6c" event={"ID":"f19d86d6-2a2f-4948-beb2-0bae1288b635","Type":"ContainerStarted","Data":"3a2693df93e67672ec3b1c697445bb3aeff9df2cbefc3463e14f9535bf28f5dd"} Jul 23 22:24:07.238187 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:07.238099 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7c5dff46bc-mxk6c" podStartSLOduration=1.8500631859999999 podStartE2EDuration="3.238081593s" totalImagesPullingTime="1.388018407s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 22:24:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:24:07.237679609 +0000 UTC m=+74.957676907" watchObservedRunningTime="2026-07-23 22:24:07.238081593 +0000 UTC m=+74.958078854" Jul 23 22:24:08.217645 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:08.217608 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"19824801-1c49-4255-ac21-bd571b9a417b","Type":"ContainerStarted","Data":"f641afb51b6752487cc2aebf70f74e21dfdeb5f5831bf5872213b051f880b9a6"} Jul 23 22:24:08.282035 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:08.281972 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=6.095831455 podStartE2EDuration="9.281952308s" totalImagesPullingTime="3.155825289s" totalInitContainerRuntime="30.295564ms" isStatefulPod=false podCreationTimestamp="2026-07-23 22:23:59 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:24:08.281508003 +0000 UTC m=+76.001505283" watchObservedRunningTime="2026-07-23 22:24:08.281952308 +0000 UTC m=+76.001949569" Jul 23 22:24:08.881995 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:08.881970 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:24:08.956289 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:08.956245 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:24:09.902904 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:09.902876 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:24:10.004684 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:10.004662 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:24:11.137753 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:11.137686 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:24:11.268373 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:11.268348 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:24:11.393372 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:11.393305 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:24:12.431297 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:12.431265 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-b66884f7-qlct5"] Jul 23 22:24:12.434556 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:12.434534 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b66884f7-qlct5" Jul 23 22:24:12.438039 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:12.438006 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 23 22:24:12.438142 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:12.438007 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-djwzz\"" Jul 23 22:24:12.438142 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:12.438007 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 23 22:24:12.438289 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:12.438273 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 23 22:24:12.438458 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:12.438440 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 23 22:24:12.438534 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:12.438465 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 23 22:24:12.438534 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:12.438465 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 23 22:24:12.438534 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:12.438513 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 23 22:24:12.443347 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:12.443328 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 23 22:24:12.447745 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:12.447729 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b66884f7-qlct5"] Jul 23 22:24:12.477939 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:12.477919 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e643c7ad-06fd-426c-8181-1cf5ccf558b2-console-config\") pod \"console-b66884f7-qlct5\" (UID: \"e643c7ad-06fd-426c-8181-1cf5ccf558b2\") " pod="openshift-console/console-b66884f7-qlct5" Jul 23 22:24:12.478054 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:12.477962 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e643c7ad-06fd-426c-8181-1cf5ccf558b2-oauth-serving-cert\") pod \"console-b66884f7-qlct5\" (UID: \"e643c7ad-06fd-426c-8181-1cf5ccf558b2\") " pod="openshift-console/console-b66884f7-qlct5" Jul 23 22:24:12.478054 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:12.477979 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dw7qh\" (UniqueName: \"kubernetes.io/projected/e643c7ad-06fd-426c-8181-1cf5ccf558b2-kube-api-access-dw7qh\") pod \"console-b66884f7-qlct5\" (UID: \"e643c7ad-06fd-426c-8181-1cf5ccf558b2\") " pod="openshift-console/console-b66884f7-qlct5" Jul 23 22:24:12.478054 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:12.477998 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e643c7ad-06fd-426c-8181-1cf5ccf558b2-console-oauth-config\") pod \"console-b66884f7-qlct5\" (UID: \"e643c7ad-06fd-426c-8181-1cf5ccf558b2\") " pod="openshift-console/console-b66884f7-qlct5" Jul 23 22:24:12.478157 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:12.478067 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e643c7ad-06fd-426c-8181-1cf5ccf558b2-service-ca\") pod \"console-b66884f7-qlct5\" (UID: \"e643c7ad-06fd-426c-8181-1cf5ccf558b2\") " pod="openshift-console/console-b66884f7-qlct5" Jul 23 22:24:12.478157 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:12.478084 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e643c7ad-06fd-426c-8181-1cf5ccf558b2-console-serving-cert\") pod \"console-b66884f7-qlct5\" (UID: \"e643c7ad-06fd-426c-8181-1cf5ccf558b2\") " pod="openshift-console/console-b66884f7-qlct5" Jul 23 22:24:12.478157 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:12.478116 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e643c7ad-06fd-426c-8181-1cf5ccf558b2-trusted-ca-bundle\") pod \"console-b66884f7-qlct5\" (UID: \"e643c7ad-06fd-426c-8181-1cf5ccf558b2\") " pod="openshift-console/console-b66884f7-qlct5" Jul 23 22:24:12.578414 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:12.578394 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e643c7ad-06fd-426c-8181-1cf5ccf558b2-trusted-ca-bundle\") pod \"console-b66884f7-qlct5\" (UID: \"e643c7ad-06fd-426c-8181-1cf5ccf558b2\") " pod="openshift-console/console-b66884f7-qlct5" Jul 23 22:24:12.578492 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:12.578428 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e643c7ad-06fd-426c-8181-1cf5ccf558b2-console-config\") pod \"console-b66884f7-qlct5\" (UID: \"e643c7ad-06fd-426c-8181-1cf5ccf558b2\") " pod="openshift-console/console-b66884f7-qlct5" Jul 23 22:24:12.578492 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:12.578480 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e643c7ad-06fd-426c-8181-1cf5ccf558b2-oauth-serving-cert\") pod \"console-b66884f7-qlct5\" (UID: \"e643c7ad-06fd-426c-8181-1cf5ccf558b2\") " pod="openshift-console/console-b66884f7-qlct5" Jul 23 22:24:12.578567 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:12.578501 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dw7qh\" (UniqueName: \"kubernetes.io/projected/e643c7ad-06fd-426c-8181-1cf5ccf558b2-kube-api-access-dw7qh\") pod \"console-b66884f7-qlct5\" (UID: \"e643c7ad-06fd-426c-8181-1cf5ccf558b2\") " pod="openshift-console/console-b66884f7-qlct5" Jul 23 22:24:12.578567 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:12.578525 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e643c7ad-06fd-426c-8181-1cf5ccf558b2-console-oauth-config\") pod \"console-b66884f7-qlct5\" (UID: \"e643c7ad-06fd-426c-8181-1cf5ccf558b2\") " pod="openshift-console/console-b66884f7-qlct5" Jul 23 22:24:12.578567 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:12.578559 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e643c7ad-06fd-426c-8181-1cf5ccf558b2-service-ca\") pod \"console-b66884f7-qlct5\" (UID: \"e643c7ad-06fd-426c-8181-1cf5ccf558b2\") " pod="openshift-console/console-b66884f7-qlct5" Jul 23 22:24:12.578702 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:12.578583 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e643c7ad-06fd-426c-8181-1cf5ccf558b2-console-serving-cert\") pod \"console-b66884f7-qlct5\" (UID: \"e643c7ad-06fd-426c-8181-1cf5ccf558b2\") " pod="openshift-console/console-b66884f7-qlct5" Jul 23 22:24:12.579226 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:12.579207 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e643c7ad-06fd-426c-8181-1cf5ccf558b2-console-config\") pod \"console-b66884f7-qlct5\" (UID: \"e643c7ad-06fd-426c-8181-1cf5ccf558b2\") " pod="openshift-console/console-b66884f7-qlct5" Jul 23 22:24:12.579323 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:12.579282 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e643c7ad-06fd-426c-8181-1cf5ccf558b2-trusted-ca-bundle\") pod \"console-b66884f7-qlct5\" (UID: \"e643c7ad-06fd-426c-8181-1cf5ccf558b2\") " pod="openshift-console/console-b66884f7-qlct5" Jul 23 22:24:12.579323 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:12.579290 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e643c7ad-06fd-426c-8181-1cf5ccf558b2-oauth-serving-cert\") pod \"console-b66884f7-qlct5\" (UID: \"e643c7ad-06fd-426c-8181-1cf5ccf558b2\") " pod="openshift-console/console-b66884f7-qlct5" Jul 23 22:24:12.579440 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:12.579418 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e643c7ad-06fd-426c-8181-1cf5ccf558b2-service-ca\") pod \"console-b66884f7-qlct5\" (UID: \"e643c7ad-06fd-426c-8181-1cf5ccf558b2\") " pod="openshift-console/console-b66884f7-qlct5" Jul 23 22:24:12.581006 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:12.580980 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e643c7ad-06fd-426c-8181-1cf5ccf558b2-console-oauth-config\") pod \"console-b66884f7-qlct5\" (UID: \"e643c7ad-06fd-426c-8181-1cf5ccf558b2\") " pod="openshift-console/console-b66884f7-qlct5" Jul 23 22:24:12.581100 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:12.581007 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e643c7ad-06fd-426c-8181-1cf5ccf558b2-console-serving-cert\") pod \"console-b66884f7-qlct5\" (UID: \"e643c7ad-06fd-426c-8181-1cf5ccf558b2\") " pod="openshift-console/console-b66884f7-qlct5" Jul 23 22:24:12.587462 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:12.587433 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dw7qh\" (UniqueName: \"kubernetes.io/projected/e643c7ad-06fd-426c-8181-1cf5ccf558b2-kube-api-access-dw7qh\") pod \"console-b66884f7-qlct5\" (UID: \"e643c7ad-06fd-426c-8181-1cf5ccf558b2\") " pod="openshift-console/console-b66884f7-qlct5" Jul 23 22:24:12.743850 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:12.743801 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b66884f7-qlct5" Jul 23 22:24:12.875450 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:12.875431 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b66884f7-qlct5"] Jul 23 22:24:12.877772 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:24:12.877745 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode643c7ad_06fd_426c_8181_1cf5ccf558b2.slice/crio-ea53fedbcbbdaf0998a23730d6ed147911d6bdc35ea404ef7851291e1ecf43be WatchSource:0}: Error finding container ea53fedbcbbdaf0998a23730d6ed147911d6bdc35ea404ef7851291e1ecf43be: Status 404 returned error can't find the container with id ea53fedbcbbdaf0998a23730d6ed147911d6bdc35ea404ef7851291e1ecf43be Jul 23 22:24:13.235853 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:13.235828 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b66884f7-qlct5" event={"ID":"e643c7ad-06fd-426c-8181-1cf5ccf558b2","Type":"ContainerStarted","Data":"ea53fedbcbbdaf0998a23730d6ed147911d6bdc35ea404ef7851291e1ecf43be"} Jul 23 22:24:13.721321 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:13.721286 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:24:13.820732 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:13.820699 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:24:16.249795 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:16.249759 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b66884f7-qlct5" event={"ID":"e643c7ad-06fd-426c-8181-1cf5ccf558b2","Type":"ContainerStarted","Data":"4f6e455e99f369c20fd7e40f950802484f85db4ead083368187411a31ecc5ba7"} Jul 23 22:24:16.270972 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:16.270928 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-b66884f7-qlct5" podStartSLOduration=1.68377669 podStartE2EDuration="4.270913589s" totalImagesPullingTime="2.587136899s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 22:24:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:24:16.269646162 +0000 UTC m=+83.989643443" watchObservedRunningTime="2026-07-23 22:24:16.270913589 +0000 UTC m=+83.990910849" Jul 23 22:24:16.518291 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:16.518219 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:24:16.595575 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:16.595530 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:24:17.961908 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:17.961869 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:24:18.023113 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:18.023088 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:24:20.715137 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:20.715107 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:24:20.815214 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:20.815192 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:24:22.743904 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:22.743878 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b66884f7-qlct5" Jul 23 22:24:22.744327 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:22.743930 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-b66884f7-qlct5" Jul 23 22:24:22.748523 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:22.748498 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-b66884f7-qlct5" Jul 23 22:24:23.277570 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:23.277546 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-b66884f7-qlct5" Jul 23 22:24:23.889932 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:23.889886 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:24:23.955784 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:23.955759 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:24:24.364383 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:24.364355 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:24:24.459868 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:24.459844 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:24:28.768789 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:28.768758 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:24:28.839757 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:28.839735 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:24:35.193871 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:35.193846 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-ks6hk" Jul 23 22:24:37.254725 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:37.254691 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:24:39.256929 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:39.256897 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:24:39.357247 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:39.357223 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:24:43.735643 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:43.735611 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:24:43.835296 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:43.835254 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:24:58.842721 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:24:58.842689 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:25:14.926176 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:14.926137 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:25:15.003349 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:15.003318 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:25:19.224032 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:19.223980 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 23 22:25:19.224467 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:19.224285 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="19824801-1c49-4255-ac21-bd571b9a417b" containerName="alertmanager" containerID="cri-o://aff6789cd26323d86d05b2c2c72afccc1c16031d267bb709864b0f8f40c700e9" gracePeriod=120 Jul 23 22:25:19.224467 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:19.224378 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="19824801-1c49-4255-ac21-bd571b9a417b" containerName="kube-rbac-proxy-metric" containerID="cri-o://bbd54e83ca5a6b97fdec81a159d847d7a770b0e60ae749d84b526c0c8bd4e0f0" gracePeriod=120 Jul 23 22:25:19.224598 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:19.224459 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="19824801-1c49-4255-ac21-bd571b9a417b" containerName="kube-rbac-proxy-web" containerID="cri-o://37b47e098ff0d4576bd3aadfb915ed80e478be92088e3ca0ba57a5d19e8f9a36" gracePeriod=120 Jul 23 22:25:19.224598 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:19.224495 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="19824801-1c49-4255-ac21-bd571b9a417b" containerName="kube-rbac-proxy" containerID="cri-o://19508bf48dc4ccefe7a293ff9621ed25b2aa84330e4a54550c6036f517840c97" gracePeriod=120 Jul 23 22:25:19.224598 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:19.224525 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="19824801-1c49-4255-ac21-bd571b9a417b" containerName="config-reloader" containerID="cri-o://fc80bc6f422fee4aa07d4601efcf5df6954e9c267a1242ecd955e08565b5212c" gracePeriod=120 Jul 23 22:25:19.224790 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:19.224740 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="19824801-1c49-4255-ac21-bd571b9a417b" containerName="prom-label-proxy" containerID="cri-o://f641afb51b6752487cc2aebf70f74e21dfdeb5f5831bf5872213b051f880b9a6" gracePeriod=120 Jul 23 22:25:19.477204 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:19.477118 2575 generic.go:356] "Generic (PLEG): container finished" podID="19824801-1c49-4255-ac21-bd571b9a417b" containerID="f641afb51b6752487cc2aebf70f74e21dfdeb5f5831bf5872213b051f880b9a6" exitCode=0 Jul 23 22:25:19.477204 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:19.477142 2575 generic.go:356] "Generic (PLEG): container finished" podID="19824801-1c49-4255-ac21-bd571b9a417b" containerID="19508bf48dc4ccefe7a293ff9621ed25b2aa84330e4a54550c6036f517840c97" exitCode=0 Jul 23 22:25:19.477204 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:19.477149 2575 generic.go:356] "Generic (PLEG): container finished" podID="19824801-1c49-4255-ac21-bd571b9a417b" containerID="fc80bc6f422fee4aa07d4601efcf5df6954e9c267a1242ecd955e08565b5212c" exitCode=0 Jul 23 22:25:19.477204 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:19.477155 2575 generic.go:356] "Generic (PLEG): container finished" podID="19824801-1c49-4255-ac21-bd571b9a417b" containerID="aff6789cd26323d86d05b2c2c72afccc1c16031d267bb709864b0f8f40c700e9" exitCode=0 Jul 23 22:25:19.477204 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:19.477193 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"19824801-1c49-4255-ac21-bd571b9a417b","Type":"ContainerDied","Data":"f641afb51b6752487cc2aebf70f74e21dfdeb5f5831bf5872213b051f880b9a6"} Jul 23 22:25:19.477483 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:19.477259 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"19824801-1c49-4255-ac21-bd571b9a417b","Type":"ContainerDied","Data":"19508bf48dc4ccefe7a293ff9621ed25b2aa84330e4a54550c6036f517840c97"} Jul 23 22:25:19.477483 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:19.477287 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"19824801-1c49-4255-ac21-bd571b9a417b","Type":"ContainerDied","Data":"fc80bc6f422fee4aa07d4601efcf5df6954e9c267a1242ecd955e08565b5212c"} Jul 23 22:25:19.477483 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:19.477311 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"19824801-1c49-4255-ac21-bd571b9a417b","Type":"ContainerDied","Data":"aff6789cd26323d86d05b2c2c72afccc1c16031d267bb709864b0f8f40c700e9"} Jul 23 22:25:20.470804 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.470773 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:25:20.483637 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.483601 2575 generic.go:356] "Generic (PLEG): container finished" podID="19824801-1c49-4255-ac21-bd571b9a417b" containerID="bbd54e83ca5a6b97fdec81a159d847d7a770b0e60ae749d84b526c0c8bd4e0f0" exitCode=0 Jul 23 22:25:20.483637 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.483633 2575 generic.go:356] "Generic (PLEG): container finished" podID="19824801-1c49-4255-ac21-bd571b9a417b" containerID="37b47e098ff0d4576bd3aadfb915ed80e478be92088e3ca0ba57a5d19e8f9a36" exitCode=0 Jul 23 22:25:20.483836 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.483675 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"19824801-1c49-4255-ac21-bd571b9a417b","Type":"ContainerDied","Data":"bbd54e83ca5a6b97fdec81a159d847d7a770b0e60ae749d84b526c0c8bd4e0f0"} Jul 23 22:25:20.483836 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.483690 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:25:20.483836 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.483746 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"19824801-1c49-4255-ac21-bd571b9a417b","Type":"ContainerDied","Data":"37b47e098ff0d4576bd3aadfb915ed80e478be92088e3ca0ba57a5d19e8f9a36"} Jul 23 22:25:20.483836 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.483785 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"19824801-1c49-4255-ac21-bd571b9a417b","Type":"ContainerDied","Data":"5777ef1bd12b22f1f8db0db0473527f0f007a662d12923ac9bc5e6e532075424"} Jul 23 22:25:20.483836 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.483834 2575 scope.go:117] "RemoveContainer" containerID="f641afb51b6752487cc2aebf70f74e21dfdeb5f5831bf5872213b051f880b9a6" Jul 23 22:25:20.491997 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.491975 2575 scope.go:117] "RemoveContainer" containerID="bbd54e83ca5a6b97fdec81a159d847d7a770b0e60ae749d84b526c0c8bd4e0f0" Jul 23 22:25:20.499447 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.499423 2575 scope.go:117] "RemoveContainer" containerID="19508bf48dc4ccefe7a293ff9621ed25b2aa84330e4a54550c6036f517840c97" Jul 23 22:25:20.508789 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.508762 2575 scope.go:117] "RemoveContainer" containerID="37b47e098ff0d4576bd3aadfb915ed80e478be92088e3ca0ba57a5d19e8f9a36" Jul 23 22:25:20.518386 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.518356 2575 scope.go:117] "RemoveContainer" containerID="fc80bc6f422fee4aa07d4601efcf5df6954e9c267a1242ecd955e08565b5212c" Jul 23 22:25:20.527547 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.527526 2575 scope.go:117] "RemoveContainer" containerID="aff6789cd26323d86d05b2c2c72afccc1c16031d267bb709864b0f8f40c700e9" Jul 23 22:25:20.536193 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.536168 2575 scope.go:117] "RemoveContainer" containerID="6cd502007a6f156047ccc586a9181332ee48bf66b712016130fe2f27e056e998" Jul 23 22:25:20.544232 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.544208 2575 scope.go:117] "RemoveContainer" containerID="f641afb51b6752487cc2aebf70f74e21dfdeb5f5831bf5872213b051f880b9a6" Jul 23 22:25:20.544642 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:25:20.544618 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f641afb51b6752487cc2aebf70f74e21dfdeb5f5831bf5872213b051f880b9a6\": container with ID starting with f641afb51b6752487cc2aebf70f74e21dfdeb5f5831bf5872213b051f880b9a6 not found: ID does not exist" containerID="f641afb51b6752487cc2aebf70f74e21dfdeb5f5831bf5872213b051f880b9a6" Jul 23 22:25:20.544720 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.544651 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f641afb51b6752487cc2aebf70f74e21dfdeb5f5831bf5872213b051f880b9a6"} err="failed to get container status \"f641afb51b6752487cc2aebf70f74e21dfdeb5f5831bf5872213b051f880b9a6\": rpc error: code = NotFound desc = could not find container \"f641afb51b6752487cc2aebf70f74e21dfdeb5f5831bf5872213b051f880b9a6\": container with ID starting with f641afb51b6752487cc2aebf70f74e21dfdeb5f5831bf5872213b051f880b9a6 not found: ID does not exist" Jul 23 22:25:20.544720 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.544685 2575 scope.go:117] "RemoveContainer" containerID="bbd54e83ca5a6b97fdec81a159d847d7a770b0e60ae749d84b526c0c8bd4e0f0" Jul 23 22:25:20.545002 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:25:20.544972 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bbd54e83ca5a6b97fdec81a159d847d7a770b0e60ae749d84b526c0c8bd4e0f0\": container with ID starting with bbd54e83ca5a6b97fdec81a159d847d7a770b0e60ae749d84b526c0c8bd4e0f0 not found: ID does not exist" containerID="bbd54e83ca5a6b97fdec81a159d847d7a770b0e60ae749d84b526c0c8bd4e0f0" Jul 23 22:25:20.545114 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.545005 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbd54e83ca5a6b97fdec81a159d847d7a770b0e60ae749d84b526c0c8bd4e0f0"} err="failed to get container status \"bbd54e83ca5a6b97fdec81a159d847d7a770b0e60ae749d84b526c0c8bd4e0f0\": rpc error: code = NotFound desc = could not find container \"bbd54e83ca5a6b97fdec81a159d847d7a770b0e60ae749d84b526c0c8bd4e0f0\": container with ID starting with bbd54e83ca5a6b97fdec81a159d847d7a770b0e60ae749d84b526c0c8bd4e0f0 not found: ID does not exist" Jul 23 22:25:20.545114 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.545040 2575 scope.go:117] "RemoveContainer" containerID="19508bf48dc4ccefe7a293ff9621ed25b2aa84330e4a54550c6036f517840c97" Jul 23 22:25:20.545274 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:25:20.545252 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19508bf48dc4ccefe7a293ff9621ed25b2aa84330e4a54550c6036f517840c97\": container with ID starting with 19508bf48dc4ccefe7a293ff9621ed25b2aa84330e4a54550c6036f517840c97 not found: ID does not exist" containerID="19508bf48dc4ccefe7a293ff9621ed25b2aa84330e4a54550c6036f517840c97" Jul 23 22:25:20.545316 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.545280 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19508bf48dc4ccefe7a293ff9621ed25b2aa84330e4a54550c6036f517840c97"} err="failed to get container status \"19508bf48dc4ccefe7a293ff9621ed25b2aa84330e4a54550c6036f517840c97\": rpc error: code = NotFound desc = could not find container \"19508bf48dc4ccefe7a293ff9621ed25b2aa84330e4a54550c6036f517840c97\": container with ID starting with 19508bf48dc4ccefe7a293ff9621ed25b2aa84330e4a54550c6036f517840c97 not found: ID does not exist" Jul 23 22:25:20.545316 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.545293 2575 scope.go:117] "RemoveContainer" containerID="37b47e098ff0d4576bd3aadfb915ed80e478be92088e3ca0ba57a5d19e8f9a36" Jul 23 22:25:20.545583 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:25:20.545567 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37b47e098ff0d4576bd3aadfb915ed80e478be92088e3ca0ba57a5d19e8f9a36\": container with ID starting with 37b47e098ff0d4576bd3aadfb915ed80e478be92088e3ca0ba57a5d19e8f9a36 not found: ID does not exist" containerID="37b47e098ff0d4576bd3aadfb915ed80e478be92088e3ca0ba57a5d19e8f9a36" Jul 23 22:25:20.545637 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.545587 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37b47e098ff0d4576bd3aadfb915ed80e478be92088e3ca0ba57a5d19e8f9a36"} err="failed to get container status \"37b47e098ff0d4576bd3aadfb915ed80e478be92088e3ca0ba57a5d19e8f9a36\": rpc error: code = NotFound desc = could not find container \"37b47e098ff0d4576bd3aadfb915ed80e478be92088e3ca0ba57a5d19e8f9a36\": container with ID starting with 37b47e098ff0d4576bd3aadfb915ed80e478be92088e3ca0ba57a5d19e8f9a36 not found: ID does not exist" Jul 23 22:25:20.545637 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.545602 2575 scope.go:117] "RemoveContainer" containerID="fc80bc6f422fee4aa07d4601efcf5df6954e9c267a1242ecd955e08565b5212c" Jul 23 22:25:20.545837 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:25:20.545823 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc80bc6f422fee4aa07d4601efcf5df6954e9c267a1242ecd955e08565b5212c\": container with ID starting with fc80bc6f422fee4aa07d4601efcf5df6954e9c267a1242ecd955e08565b5212c not found: ID does not exist" containerID="fc80bc6f422fee4aa07d4601efcf5df6954e9c267a1242ecd955e08565b5212c" Jul 23 22:25:20.545887 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.545842 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc80bc6f422fee4aa07d4601efcf5df6954e9c267a1242ecd955e08565b5212c"} err="failed to get container status \"fc80bc6f422fee4aa07d4601efcf5df6954e9c267a1242ecd955e08565b5212c\": rpc error: code = NotFound desc = could not find container \"fc80bc6f422fee4aa07d4601efcf5df6954e9c267a1242ecd955e08565b5212c\": container with ID starting with fc80bc6f422fee4aa07d4601efcf5df6954e9c267a1242ecd955e08565b5212c not found: ID does not exist" Jul 23 22:25:20.545887 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.545858 2575 scope.go:117] "RemoveContainer" containerID="aff6789cd26323d86d05b2c2c72afccc1c16031d267bb709864b0f8f40c700e9" Jul 23 22:25:20.546076 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:25:20.546059 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aff6789cd26323d86d05b2c2c72afccc1c16031d267bb709864b0f8f40c700e9\": container with ID starting with aff6789cd26323d86d05b2c2c72afccc1c16031d267bb709864b0f8f40c700e9 not found: ID does not exist" containerID="aff6789cd26323d86d05b2c2c72afccc1c16031d267bb709864b0f8f40c700e9" Jul 23 22:25:20.546121 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.546080 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aff6789cd26323d86d05b2c2c72afccc1c16031d267bb709864b0f8f40c700e9"} err="failed to get container status \"aff6789cd26323d86d05b2c2c72afccc1c16031d267bb709864b0f8f40c700e9\": rpc error: code = NotFound desc = could not find container \"aff6789cd26323d86d05b2c2c72afccc1c16031d267bb709864b0f8f40c700e9\": container with ID starting with aff6789cd26323d86d05b2c2c72afccc1c16031d267bb709864b0f8f40c700e9 not found: ID does not exist" Jul 23 22:25:20.546121 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.546093 2575 scope.go:117] "RemoveContainer" containerID="6cd502007a6f156047ccc586a9181332ee48bf66b712016130fe2f27e056e998" Jul 23 22:25:20.546322 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:25:20.546307 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6cd502007a6f156047ccc586a9181332ee48bf66b712016130fe2f27e056e998\": container with ID starting with 6cd502007a6f156047ccc586a9181332ee48bf66b712016130fe2f27e056e998 not found: ID does not exist" containerID="6cd502007a6f156047ccc586a9181332ee48bf66b712016130fe2f27e056e998" Jul 23 22:25:20.546372 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.546325 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6cd502007a6f156047ccc586a9181332ee48bf66b712016130fe2f27e056e998"} err="failed to get container status \"6cd502007a6f156047ccc586a9181332ee48bf66b712016130fe2f27e056e998\": rpc error: code = NotFound desc = could not find container \"6cd502007a6f156047ccc586a9181332ee48bf66b712016130fe2f27e056e998\": container with ID starting with 6cd502007a6f156047ccc586a9181332ee48bf66b712016130fe2f27e056e998 not found: ID does not exist" Jul 23 22:25:20.546372 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.546336 2575 scope.go:117] "RemoveContainer" containerID="f641afb51b6752487cc2aebf70f74e21dfdeb5f5831bf5872213b051f880b9a6" Jul 23 22:25:20.546565 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.546549 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f641afb51b6752487cc2aebf70f74e21dfdeb5f5831bf5872213b051f880b9a6"} err="failed to get container status \"f641afb51b6752487cc2aebf70f74e21dfdeb5f5831bf5872213b051f880b9a6\": rpc error: code = NotFound desc = could not find container \"f641afb51b6752487cc2aebf70f74e21dfdeb5f5831bf5872213b051f880b9a6\": container with ID starting with f641afb51b6752487cc2aebf70f74e21dfdeb5f5831bf5872213b051f880b9a6 not found: ID does not exist" Jul 23 22:25:20.546611 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.546566 2575 scope.go:117] "RemoveContainer" containerID="bbd54e83ca5a6b97fdec81a159d847d7a770b0e60ae749d84b526c0c8bd4e0f0" Jul 23 22:25:20.546770 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.546754 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbd54e83ca5a6b97fdec81a159d847d7a770b0e60ae749d84b526c0c8bd4e0f0"} err="failed to get container status \"bbd54e83ca5a6b97fdec81a159d847d7a770b0e60ae749d84b526c0c8bd4e0f0\": rpc error: code = NotFound desc = could not find container \"bbd54e83ca5a6b97fdec81a159d847d7a770b0e60ae749d84b526c0c8bd4e0f0\": container with ID starting with bbd54e83ca5a6b97fdec81a159d847d7a770b0e60ae749d84b526c0c8bd4e0f0 not found: ID does not exist" Jul 23 22:25:20.546817 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.546770 2575 scope.go:117] "RemoveContainer" containerID="19508bf48dc4ccefe7a293ff9621ed25b2aa84330e4a54550c6036f517840c97" Jul 23 22:25:20.546990 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.546974 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19508bf48dc4ccefe7a293ff9621ed25b2aa84330e4a54550c6036f517840c97"} err="failed to get container status \"19508bf48dc4ccefe7a293ff9621ed25b2aa84330e4a54550c6036f517840c97\": rpc error: code = NotFound desc = could not find container \"19508bf48dc4ccefe7a293ff9621ed25b2aa84330e4a54550c6036f517840c97\": container with ID starting with 19508bf48dc4ccefe7a293ff9621ed25b2aa84330e4a54550c6036f517840c97 not found: ID does not exist" Jul 23 22:25:20.546990 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.546989 2575 scope.go:117] "RemoveContainer" containerID="37b47e098ff0d4576bd3aadfb915ed80e478be92088e3ca0ba57a5d19e8f9a36" Jul 23 22:25:20.547243 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.547225 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37b47e098ff0d4576bd3aadfb915ed80e478be92088e3ca0ba57a5d19e8f9a36"} err="failed to get container status \"37b47e098ff0d4576bd3aadfb915ed80e478be92088e3ca0ba57a5d19e8f9a36\": rpc error: code = NotFound desc = could not find container \"37b47e098ff0d4576bd3aadfb915ed80e478be92088e3ca0ba57a5d19e8f9a36\": container with ID starting with 37b47e098ff0d4576bd3aadfb915ed80e478be92088e3ca0ba57a5d19e8f9a36 not found: ID does not exist" Jul 23 22:25:20.547283 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.547244 2575 scope.go:117] "RemoveContainer" containerID="fc80bc6f422fee4aa07d4601efcf5df6954e9c267a1242ecd955e08565b5212c" Jul 23 22:25:20.547422 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.547404 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc80bc6f422fee4aa07d4601efcf5df6954e9c267a1242ecd955e08565b5212c"} err="failed to get container status \"fc80bc6f422fee4aa07d4601efcf5df6954e9c267a1242ecd955e08565b5212c\": rpc error: code = NotFound desc = could not find container \"fc80bc6f422fee4aa07d4601efcf5df6954e9c267a1242ecd955e08565b5212c\": container with ID starting with fc80bc6f422fee4aa07d4601efcf5df6954e9c267a1242ecd955e08565b5212c not found: ID does not exist" Jul 23 22:25:20.547464 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.547424 2575 scope.go:117] "RemoveContainer" containerID="aff6789cd26323d86d05b2c2c72afccc1c16031d267bb709864b0f8f40c700e9" Jul 23 22:25:20.547609 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.547585 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aff6789cd26323d86d05b2c2c72afccc1c16031d267bb709864b0f8f40c700e9"} err="failed to get container status \"aff6789cd26323d86d05b2c2c72afccc1c16031d267bb709864b0f8f40c700e9\": rpc error: code = NotFound desc = could not find container \"aff6789cd26323d86d05b2c2c72afccc1c16031d267bb709864b0f8f40c700e9\": container with ID starting with aff6789cd26323d86d05b2c2c72afccc1c16031d267bb709864b0f8f40c700e9 not found: ID does not exist" Jul 23 22:25:20.547655 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.547612 2575 scope.go:117] "RemoveContainer" containerID="6cd502007a6f156047ccc586a9181332ee48bf66b712016130fe2f27e056e998" Jul 23 22:25:20.547851 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.547833 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6cd502007a6f156047ccc586a9181332ee48bf66b712016130fe2f27e056e998"} err="failed to get container status \"6cd502007a6f156047ccc586a9181332ee48bf66b712016130fe2f27e056e998\": rpc error: code = NotFound desc = could not find container \"6cd502007a6f156047ccc586a9181332ee48bf66b712016130fe2f27e056e998\": container with ID starting with 6cd502007a6f156047ccc586a9181332ee48bf66b712016130fe2f27e056e998 not found: ID does not exist" Jul 23 22:25:20.562334 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.562299 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/19824801-1c49-4255-ac21-bd571b9a417b-secret-alertmanager-kube-rbac-proxy-web\") pod \"19824801-1c49-4255-ac21-bd571b9a417b\" (UID: \"19824801-1c49-4255-ac21-bd571b9a417b\") " Jul 23 22:25:20.562504 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.562381 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/19824801-1c49-4255-ac21-bd571b9a417b-config-out\") pod \"19824801-1c49-4255-ac21-bd571b9a417b\" (UID: \"19824801-1c49-4255-ac21-bd571b9a417b\") " Jul 23 22:25:20.562504 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.562402 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/19824801-1c49-4255-ac21-bd571b9a417b-secret-alertmanager-main-tls\") pod \"19824801-1c49-4255-ac21-bd571b9a417b\" (UID: \"19824801-1c49-4255-ac21-bd571b9a417b\") " Jul 23 22:25:20.562504 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.562428 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/19824801-1c49-4255-ac21-bd571b9a417b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"19824801-1c49-4255-ac21-bd571b9a417b\" (UID: \"19824801-1c49-4255-ac21-bd571b9a417b\") " Jul 23 22:25:20.562504 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.562447 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/19824801-1c49-4255-ac21-bd571b9a417b-alertmanager-main-db\") pod \"19824801-1c49-4255-ac21-bd571b9a417b\" (UID: \"19824801-1c49-4255-ac21-bd571b9a417b\") " Jul 23 22:25:20.562504 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.562475 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/19824801-1c49-4255-ac21-bd571b9a417b-secret-alertmanager-kube-rbac-proxy\") pod \"19824801-1c49-4255-ac21-bd571b9a417b\" (UID: \"19824801-1c49-4255-ac21-bd571b9a417b\") " Jul 23 22:25:20.562730 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.562513 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/19824801-1c49-4255-ac21-bd571b9a417b-alertmanager-trusted-ca-bundle\") pod \"19824801-1c49-4255-ac21-bd571b9a417b\" (UID: \"19824801-1c49-4255-ac21-bd571b9a417b\") " Jul 23 22:25:20.562730 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.562546 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/19824801-1c49-4255-ac21-bd571b9a417b-web-config\") pod \"19824801-1c49-4255-ac21-bd571b9a417b\" (UID: \"19824801-1c49-4255-ac21-bd571b9a417b\") " Jul 23 22:25:20.562730 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.562577 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/19824801-1c49-4255-ac21-bd571b9a417b-tls-assets\") pod \"19824801-1c49-4255-ac21-bd571b9a417b\" (UID: \"19824801-1c49-4255-ac21-bd571b9a417b\") " Jul 23 22:25:20.562730 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.562611 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sdxvt\" (UniqueName: \"kubernetes.io/projected/19824801-1c49-4255-ac21-bd571b9a417b-kube-api-access-sdxvt\") pod \"19824801-1c49-4255-ac21-bd571b9a417b\" (UID: \"19824801-1c49-4255-ac21-bd571b9a417b\") " Jul 23 22:25:20.562730 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.562644 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/19824801-1c49-4255-ac21-bd571b9a417b-config-volume\") pod \"19824801-1c49-4255-ac21-bd571b9a417b\" (UID: \"19824801-1c49-4255-ac21-bd571b9a417b\") " Jul 23 22:25:20.562730 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.562670 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/19824801-1c49-4255-ac21-bd571b9a417b-metrics-client-ca\") pod \"19824801-1c49-4255-ac21-bd571b9a417b\" (UID: \"19824801-1c49-4255-ac21-bd571b9a417b\") " Jul 23 22:25:20.562730 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.562706 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/19824801-1c49-4255-ac21-bd571b9a417b-cluster-tls-config\") pod \"19824801-1c49-4255-ac21-bd571b9a417b\" (UID: \"19824801-1c49-4255-ac21-bd571b9a417b\") " Jul 23 22:25:20.563093 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.563006 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19824801-1c49-4255-ac21-bd571b9a417b-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "19824801-1c49-4255-ac21-bd571b9a417b" (UID: "19824801-1c49-4255-ac21-bd571b9a417b"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 22:25:20.563903 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.563441 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19824801-1c49-4255-ac21-bd571b9a417b-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "19824801-1c49-4255-ac21-bd571b9a417b" (UID: "19824801-1c49-4255-ac21-bd571b9a417b"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 22:25:20.563903 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.563837 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19824801-1c49-4255-ac21-bd571b9a417b-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "19824801-1c49-4255-ac21-bd571b9a417b" (UID: "19824801-1c49-4255-ac21-bd571b9a417b"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 22:25:20.566380 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.566353 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19824801-1c49-4255-ac21-bd571b9a417b-config-out" (OuterVolumeSpecName: "config-out") pod "19824801-1c49-4255-ac21-bd571b9a417b" (UID: "19824801-1c49-4255-ac21-bd571b9a417b"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 22:25:20.566524 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.566350 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19824801-1c49-4255-ac21-bd571b9a417b-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "19824801-1c49-4255-ac21-bd571b9a417b" (UID: "19824801-1c49-4255-ac21-bd571b9a417b"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 22:25:20.566524 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.566488 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19824801-1c49-4255-ac21-bd571b9a417b-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "19824801-1c49-4255-ac21-bd571b9a417b" (UID: "19824801-1c49-4255-ac21-bd571b9a417b"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 22:25:20.566723 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.566698 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19824801-1c49-4255-ac21-bd571b9a417b-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "19824801-1c49-4255-ac21-bd571b9a417b" (UID: "19824801-1c49-4255-ac21-bd571b9a417b"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 22:25:20.566865 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.566826 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19824801-1c49-4255-ac21-bd571b9a417b-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "19824801-1c49-4255-ac21-bd571b9a417b" (UID: "19824801-1c49-4255-ac21-bd571b9a417b"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 22:25:20.567069 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.567051 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19824801-1c49-4255-ac21-bd571b9a417b-kube-api-access-sdxvt" (OuterVolumeSpecName: "kube-api-access-sdxvt") pod "19824801-1c49-4255-ac21-bd571b9a417b" (UID: "19824801-1c49-4255-ac21-bd571b9a417b"). InnerVolumeSpecName "kube-api-access-sdxvt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 22:25:20.567139 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.567054 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19824801-1c49-4255-ac21-bd571b9a417b-config-volume" (OuterVolumeSpecName: "config-volume") pod "19824801-1c49-4255-ac21-bd571b9a417b" (UID: "19824801-1c49-4255-ac21-bd571b9a417b"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 22:25:20.567996 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.567977 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19824801-1c49-4255-ac21-bd571b9a417b-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "19824801-1c49-4255-ac21-bd571b9a417b" (UID: "19824801-1c49-4255-ac21-bd571b9a417b"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 22:25:20.570760 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.570672 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19824801-1c49-4255-ac21-bd571b9a417b-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "19824801-1c49-4255-ac21-bd571b9a417b" (UID: "19824801-1c49-4255-ac21-bd571b9a417b"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 22:25:20.577473 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.577440 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19824801-1c49-4255-ac21-bd571b9a417b-web-config" (OuterVolumeSpecName: "web-config") pod "19824801-1c49-4255-ac21-bd571b9a417b" (UID: "19824801-1c49-4255-ac21-bd571b9a417b"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 22:25:20.663828 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.663789 2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/19824801-1c49-4255-ac21-bd571b9a417b-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 22:25:20.663828 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.663818 2575 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/19824801-1c49-4255-ac21-bd571b9a417b-config-out\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 22:25:20.663828 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.663832 2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/19824801-1c49-4255-ac21-bd571b9a417b-secret-alertmanager-main-tls\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 22:25:20.664097 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.663843 2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/19824801-1c49-4255-ac21-bd571b9a417b-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 22:25:20.664097 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.663852 2575 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/19824801-1c49-4255-ac21-bd571b9a417b-alertmanager-main-db\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 22:25:20.664097 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.663860 2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/19824801-1c49-4255-ac21-bd571b9a417b-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 22:25:20.664097 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.663869 2575 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/19824801-1c49-4255-ac21-bd571b9a417b-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 22:25:20.664097 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.663877 2575 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/19824801-1c49-4255-ac21-bd571b9a417b-web-config\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 22:25:20.664097 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.663885 2575 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/19824801-1c49-4255-ac21-bd571b9a417b-tls-assets\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 22:25:20.664097 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.663892 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sdxvt\" (UniqueName: \"kubernetes.io/projected/19824801-1c49-4255-ac21-bd571b9a417b-kube-api-access-sdxvt\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 22:25:20.664097 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.663906 2575 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/19824801-1c49-4255-ac21-bd571b9a417b-config-volume\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 22:25:20.664097 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.663917 2575 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/19824801-1c49-4255-ac21-bd571b9a417b-metrics-client-ca\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 22:25:20.664097 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.663925 2575 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/19824801-1c49-4255-ac21-bd571b9a417b-cluster-tls-config\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 22:25:20.808428 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.808394 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 23 22:25:20.811849 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.811819 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 23 22:25:20.848427 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.846252 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 23 22:25:20.848427 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.846645 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19824801-1c49-4255-ac21-bd571b9a417b" containerName="config-reloader" Jul 23 22:25:20.848427 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.846667 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="19824801-1c49-4255-ac21-bd571b9a417b" containerName="config-reloader" Jul 23 22:25:20.848427 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.846684 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19824801-1c49-4255-ac21-bd571b9a417b" containerName="alertmanager" Jul 23 22:25:20.848427 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.846693 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="19824801-1c49-4255-ac21-bd571b9a417b" containerName="alertmanager" Jul 23 22:25:20.848427 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.846702 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19824801-1c49-4255-ac21-bd571b9a417b" containerName="kube-rbac-proxy-web" Jul 23 22:25:20.848427 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.846711 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="19824801-1c49-4255-ac21-bd571b9a417b" containerName="kube-rbac-proxy-web" Jul 23 22:25:20.848427 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.846735 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19824801-1c49-4255-ac21-bd571b9a417b" containerName="prom-label-proxy" Jul 23 22:25:20.848427 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.846745 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="19824801-1c49-4255-ac21-bd571b9a417b" containerName="prom-label-proxy" Jul 23 22:25:20.848427 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.846758 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19824801-1c49-4255-ac21-bd571b9a417b" containerName="init-config-reloader" Jul 23 22:25:20.848427 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.846767 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="19824801-1c49-4255-ac21-bd571b9a417b" containerName="init-config-reloader" Jul 23 22:25:20.848427 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.846777 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19824801-1c49-4255-ac21-bd571b9a417b" containerName="kube-rbac-proxy" Jul 23 22:25:20.848427 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.846785 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="19824801-1c49-4255-ac21-bd571b9a417b" containerName="kube-rbac-proxy" Jul 23 22:25:20.848427 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.846795 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19824801-1c49-4255-ac21-bd571b9a417b" containerName="kube-rbac-proxy-metric" Jul 23 22:25:20.848427 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.846803 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="19824801-1c49-4255-ac21-bd571b9a417b" containerName="kube-rbac-proxy-metric" Jul 23 22:25:20.848427 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.846866 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="19824801-1c49-4255-ac21-bd571b9a417b" containerName="kube-rbac-proxy-metric" Jul 23 22:25:20.848427 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.846877 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="19824801-1c49-4255-ac21-bd571b9a417b" containerName="kube-rbac-proxy-web" Jul 23 22:25:20.848427 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.846887 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="19824801-1c49-4255-ac21-bd571b9a417b" containerName="prom-label-proxy" Jul 23 22:25:20.848427 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.846895 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="19824801-1c49-4255-ac21-bd571b9a417b" containerName="kube-rbac-proxy" Jul 23 22:25:20.848427 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.846903 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="19824801-1c49-4255-ac21-bd571b9a417b" containerName="alertmanager" Jul 23 22:25:20.848427 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.846910 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="19824801-1c49-4255-ac21-bd571b9a417b" containerName="config-reloader" Jul 23 22:25:20.853199 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.851445 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:25:20.855561 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.854585 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 23 22:25:20.855561 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.854829 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 23 22:25:20.855561 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.855205 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-vv7xn\"" Jul 23 22:25:20.855561 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.855386 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 23 22:25:20.855829 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.855581 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 23 22:25:20.855829 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.855743 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 23 22:25:20.856985 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.855926 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 23 22:25:20.874428 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.873589 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 23 22:25:20.874428 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.873894 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 23 22:25:20.874658 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.874507 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 23 22:25:20.876263 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.875836 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b6f817a1-41e5-4ad9-ac58-adb648f2f644-web-config\") pod \"alertmanager-main-0\" (UID: \"b6f817a1-41e5-4ad9-ac58-adb648f2f644\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:25:20.876263 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.875897 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b6f817a1-41e5-4ad9-ac58-adb648f2f644-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b6f817a1-41e5-4ad9-ac58-adb648f2f644\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:25:20.876263 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.875944 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b6f817a1-41e5-4ad9-ac58-adb648f2f644-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b6f817a1-41e5-4ad9-ac58-adb648f2f644\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:25:20.876263 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.875978 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b6f817a1-41e5-4ad9-ac58-adb648f2f644-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b6f817a1-41e5-4ad9-ac58-adb648f2f644\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:25:20.876263 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.876011 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b6f817a1-41e5-4ad9-ac58-adb648f2f644-config-volume\") pod \"alertmanager-main-0\" (UID: \"b6f817a1-41e5-4ad9-ac58-adb648f2f644\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:25:20.876263 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.876072 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b6f817a1-41e5-4ad9-ac58-adb648f2f644-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b6f817a1-41e5-4ad9-ac58-adb648f2f644\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:25:20.876263 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.876106 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b6f817a1-41e5-4ad9-ac58-adb648f2f644-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b6f817a1-41e5-4ad9-ac58-adb648f2f644\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:25:20.876263 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.876156 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7wks\" (UniqueName: \"kubernetes.io/projected/b6f817a1-41e5-4ad9-ac58-adb648f2f644-kube-api-access-n7wks\") pod \"alertmanager-main-0\" (UID: \"b6f817a1-41e5-4ad9-ac58-adb648f2f644\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:25:20.876263 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.876198 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6f817a1-41e5-4ad9-ac58-adb648f2f644-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b6f817a1-41e5-4ad9-ac58-adb648f2f644\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:25:20.876263 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.876232 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b6f817a1-41e5-4ad9-ac58-adb648f2f644-config-out\") pod \"alertmanager-main-0\" (UID: \"b6f817a1-41e5-4ad9-ac58-adb648f2f644\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:25:20.876263 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.876265 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b6f817a1-41e5-4ad9-ac58-adb648f2f644-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b6f817a1-41e5-4ad9-ac58-adb648f2f644\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:25:20.879392 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.876306 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b6f817a1-41e5-4ad9-ac58-adb648f2f644-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b6f817a1-41e5-4ad9-ac58-adb648f2f644\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:25:20.879392 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.876368 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b6f817a1-41e5-4ad9-ac58-adb648f2f644-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b6f817a1-41e5-4ad9-ac58-adb648f2f644\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:25:20.880242 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.879769 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 23 22:25:20.977763 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.977724 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b6f817a1-41e5-4ad9-ac58-adb648f2f644-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b6f817a1-41e5-4ad9-ac58-adb648f2f644\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:25:20.977763 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.977767 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b6f817a1-41e5-4ad9-ac58-adb648f2f644-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b6f817a1-41e5-4ad9-ac58-adb648f2f644\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:25:20.978057 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.977791 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7wks\" (UniqueName: \"kubernetes.io/projected/b6f817a1-41e5-4ad9-ac58-adb648f2f644-kube-api-access-n7wks\") pod \"alertmanager-main-0\" (UID: \"b6f817a1-41e5-4ad9-ac58-adb648f2f644\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:25:20.978057 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.977812 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6f817a1-41e5-4ad9-ac58-adb648f2f644-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b6f817a1-41e5-4ad9-ac58-adb648f2f644\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:25:20.978057 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.977836 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b6f817a1-41e5-4ad9-ac58-adb648f2f644-config-out\") pod \"alertmanager-main-0\" (UID: \"b6f817a1-41e5-4ad9-ac58-adb648f2f644\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:25:20.978057 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.977865 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b6f817a1-41e5-4ad9-ac58-adb648f2f644-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b6f817a1-41e5-4ad9-ac58-adb648f2f644\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:25:20.978057 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.977889 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b6f817a1-41e5-4ad9-ac58-adb648f2f644-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b6f817a1-41e5-4ad9-ac58-adb648f2f644\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:25:20.978057 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.977918 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b6f817a1-41e5-4ad9-ac58-adb648f2f644-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b6f817a1-41e5-4ad9-ac58-adb648f2f644\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:25:20.978057 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.977955 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b6f817a1-41e5-4ad9-ac58-adb648f2f644-web-config\") pod \"alertmanager-main-0\" (UID: \"b6f817a1-41e5-4ad9-ac58-adb648f2f644\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:25:20.978057 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.977982 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b6f817a1-41e5-4ad9-ac58-adb648f2f644-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b6f817a1-41e5-4ad9-ac58-adb648f2f644\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:25:20.978057 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.978007 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b6f817a1-41e5-4ad9-ac58-adb648f2f644-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b6f817a1-41e5-4ad9-ac58-adb648f2f644\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:25:20.978057 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.978062 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b6f817a1-41e5-4ad9-ac58-adb648f2f644-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b6f817a1-41e5-4ad9-ac58-adb648f2f644\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:25:20.978523 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.978088 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b6f817a1-41e5-4ad9-ac58-adb648f2f644-config-volume\") pod \"alertmanager-main-0\" (UID: \"b6f817a1-41e5-4ad9-ac58-adb648f2f644\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:25:20.978842 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.978812 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b6f817a1-41e5-4ad9-ac58-adb648f2f644-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b6f817a1-41e5-4ad9-ac58-adb648f2f644\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:25:20.979143 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.979120 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b6f817a1-41e5-4ad9-ac58-adb648f2f644-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b6f817a1-41e5-4ad9-ac58-adb648f2f644\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:25:20.979237 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.979168 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6f817a1-41e5-4ad9-ac58-adb648f2f644-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b6f817a1-41e5-4ad9-ac58-adb648f2f644\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:25:20.980673 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.980642 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b6f817a1-41e5-4ad9-ac58-adb648f2f644-config-out\") pod \"alertmanager-main-0\" (UID: \"b6f817a1-41e5-4ad9-ac58-adb648f2f644\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:25:20.980925 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.980894 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b6f817a1-41e5-4ad9-ac58-adb648f2f644-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b6f817a1-41e5-4ad9-ac58-adb648f2f644\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:25:20.981209 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.981178 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b6f817a1-41e5-4ad9-ac58-adb648f2f644-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b6f817a1-41e5-4ad9-ac58-adb648f2f644\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:25:20.981304 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.981217 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b6f817a1-41e5-4ad9-ac58-adb648f2f644-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b6f817a1-41e5-4ad9-ac58-adb648f2f644\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:25:20.981609 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.981587 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b6f817a1-41e5-4ad9-ac58-adb648f2f644-config-volume\") pod \"alertmanager-main-0\" (UID: \"b6f817a1-41e5-4ad9-ac58-adb648f2f644\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:25:20.981703 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.981614 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b6f817a1-41e5-4ad9-ac58-adb648f2f644-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b6f817a1-41e5-4ad9-ac58-adb648f2f644\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:25:20.981703 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.981637 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b6f817a1-41e5-4ad9-ac58-adb648f2f644-web-config\") pod \"alertmanager-main-0\" (UID: \"b6f817a1-41e5-4ad9-ac58-adb648f2f644\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:25:20.981797 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.981744 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b6f817a1-41e5-4ad9-ac58-adb648f2f644-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b6f817a1-41e5-4ad9-ac58-adb648f2f644\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:25:20.982629 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.982611 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b6f817a1-41e5-4ad9-ac58-adb648f2f644-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b6f817a1-41e5-4ad9-ac58-adb648f2f644\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:25:20.987170 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:20.987149 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7wks\" (UniqueName: \"kubernetes.io/projected/b6f817a1-41e5-4ad9-ac58-adb648f2f644-kube-api-access-n7wks\") pod \"alertmanager-main-0\" (UID: \"b6f817a1-41e5-4ad9-ac58-adb648f2f644\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:25:21.184062 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:21.184003 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 23 22:25:21.327940 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:21.327762 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 23 22:25:21.330713 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:25:21.330682 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6f817a1_41e5_4ad9_ac58_adb648f2f644.slice/crio-e18d54333fca37c282d09b986314d606be172a153e648d216700f104c1b1eac1 WatchSource:0}: Error finding container e18d54333fca37c282d09b986314d606be172a153e648d216700f104c1b1eac1: Status 404 returned error can't find the container with id e18d54333fca37c282d09b986314d606be172a153e648d216700f104c1b1eac1 Jul 23 22:25:21.489621 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:21.489521 2575 generic.go:356] "Generic (PLEG): container finished" podID="b6f817a1-41e5-4ad9-ac58-adb648f2f644" containerID="482c14afd506a3e9f7cefffb1539cbc1507d15836de49850d6703749435bbf9d" exitCode=0 Jul 23 22:25:21.489994 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:21.489612 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b6f817a1-41e5-4ad9-ac58-adb648f2f644","Type":"ContainerDied","Data":"482c14afd506a3e9f7cefffb1539cbc1507d15836de49850d6703749435bbf9d"} Jul 23 22:25:21.489994 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:21.489717 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b6f817a1-41e5-4ad9-ac58-adb648f2f644","Type":"ContainerStarted","Data":"e18d54333fca37c282d09b986314d606be172a153e648d216700f104c1b1eac1"} Jul 23 22:25:22.497162 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:22.497129 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b6f817a1-41e5-4ad9-ac58-adb648f2f644","Type":"ContainerStarted","Data":"46b2315bdc43e3a124690dd629ff20c3889da1204e765af34c9edd3849b195c6"} Jul 23 22:25:22.497535 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:22.497194 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b6f817a1-41e5-4ad9-ac58-adb648f2f644","Type":"ContainerStarted","Data":"54163b025f5d5c6e9336bac7720473bd98709aa68cae90e56aca4a71537deddd"} Jul 23 22:25:22.497535 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:22.497221 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b6f817a1-41e5-4ad9-ac58-adb648f2f644","Type":"ContainerStarted","Data":"0fcb4caf850af1a37e7112d6ccd664423aacd11fa709b860294e470652301e03"} Jul 23 22:25:22.497535 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:22.497246 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b6f817a1-41e5-4ad9-ac58-adb648f2f644","Type":"ContainerStarted","Data":"c5f6d4bcf9bee2cdc9f180ffe2194d34d7d4cfbf985b049692a608bb96be8c29"} Jul 23 22:25:22.497535 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:22.497270 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b6f817a1-41e5-4ad9-ac58-adb648f2f644","Type":"ContainerStarted","Data":"4862da5c44773bf83a3fd96e59bb9d7333f39f9f408e48089e0f4174d3d1dc50"} Jul 23 22:25:22.497535 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:22.497295 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b6f817a1-41e5-4ad9-ac58-adb648f2f644","Type":"ContainerStarted","Data":"168b2a423cf5683599538a74c17f8b6db5087868792f0951a7b0a05d147edcf5"} Jul 23 22:25:22.525644 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:22.525577 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.509096989 podStartE2EDuration="2.525555069s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.45808ms" isStatefulPod=false podCreationTimestamp="2026-07-23 22:25:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:25:22.523630755 +0000 UTC m=+150.243628017" watchObservedRunningTime="2026-07-23 22:25:22.525555069 +0000 UTC m=+150.245552333" Jul 23 22:25:22.805975 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:22.805940 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19824801-1c49-4255-ac21-bd571b9a417b" path="/var/lib/kubelet/pods/19824801-1c49-4255-ac21-bd571b9a417b/volumes" Jul 23 22:25:26.848271 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:26.848235 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:25:26.947904 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:26.947878 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:25:43.725070 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:43.725012 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:25:43.829074 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:43.829045 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:25:43.925879 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:43.925851 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:25:44.449110 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:44.449075 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-58f575999-6hpvx"] Jul 23 22:25:44.451243 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:44.451224 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58f575999-6hpvx" Jul 23 22:25:44.465421 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:44.465374 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58f575999-6hpvx"] Jul 23 22:25:44.508920 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:44.508890 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:25:44.565422 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:44.565355 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a9ff9839-b9c0-463c-8969-906a1124b70d-console-config\") pod \"console-58f575999-6hpvx\" (UID: \"a9ff9839-b9c0-463c-8969-906a1124b70d\") " pod="openshift-console/console-58f575999-6hpvx" Jul 23 22:25:44.565422 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:44.565405 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2dbr\" (UniqueName: \"kubernetes.io/projected/a9ff9839-b9c0-463c-8969-906a1124b70d-kube-api-access-n2dbr\") pod \"console-58f575999-6hpvx\" (UID: \"a9ff9839-b9c0-463c-8969-906a1124b70d\") " pod="openshift-console/console-58f575999-6hpvx" Jul 23 22:25:44.565607 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:44.565494 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a9ff9839-b9c0-463c-8969-906a1124b70d-console-serving-cert\") pod \"console-58f575999-6hpvx\" (UID: \"a9ff9839-b9c0-463c-8969-906a1124b70d\") " pod="openshift-console/console-58f575999-6hpvx" Jul 23 22:25:44.565607 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:44.565564 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a9ff9839-b9c0-463c-8969-906a1124b70d-console-oauth-config\") pod \"console-58f575999-6hpvx\" (UID: \"a9ff9839-b9c0-463c-8969-906a1124b70d\") " pod="openshift-console/console-58f575999-6hpvx" Jul 23 22:25:44.565607 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:44.565599 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a9ff9839-b9c0-463c-8969-906a1124b70d-service-ca\") pod \"console-58f575999-6hpvx\" (UID: \"a9ff9839-b9c0-463c-8969-906a1124b70d\") " pod="openshift-console/console-58f575999-6hpvx" Jul 23 22:25:44.565733 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:44.565623 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9ff9839-b9c0-463c-8969-906a1124b70d-trusted-ca-bundle\") pod \"console-58f575999-6hpvx\" (UID: \"a9ff9839-b9c0-463c-8969-906a1124b70d\") " pod="openshift-console/console-58f575999-6hpvx" Jul 23 22:25:44.565733 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:44.565651 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a9ff9839-b9c0-463c-8969-906a1124b70d-oauth-serving-cert\") pod \"console-58f575999-6hpvx\" (UID: \"a9ff9839-b9c0-463c-8969-906a1124b70d\") " pod="openshift-console/console-58f575999-6hpvx" Jul 23 22:25:44.666734 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:44.666698 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a9ff9839-b9c0-463c-8969-906a1124b70d-oauth-serving-cert\") pod \"console-58f575999-6hpvx\" (UID: \"a9ff9839-b9c0-463c-8969-906a1124b70d\") " pod="openshift-console/console-58f575999-6hpvx" Jul 23 22:25:44.666894 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:44.666767 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a9ff9839-b9c0-463c-8969-906a1124b70d-console-config\") pod \"console-58f575999-6hpvx\" (UID: \"a9ff9839-b9c0-463c-8969-906a1124b70d\") " pod="openshift-console/console-58f575999-6hpvx" Jul 23 22:25:44.666894 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:44.666809 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2dbr\" (UniqueName: \"kubernetes.io/projected/a9ff9839-b9c0-463c-8969-906a1124b70d-kube-api-access-n2dbr\") pod \"console-58f575999-6hpvx\" (UID: \"a9ff9839-b9c0-463c-8969-906a1124b70d\") " pod="openshift-console/console-58f575999-6hpvx" Jul 23 22:25:44.666894 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:44.666862 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a9ff9839-b9c0-463c-8969-906a1124b70d-console-serving-cert\") pod \"console-58f575999-6hpvx\" (UID: \"a9ff9839-b9c0-463c-8969-906a1124b70d\") " pod="openshift-console/console-58f575999-6hpvx" Jul 23 22:25:44.667102 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:44.666900 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a9ff9839-b9c0-463c-8969-906a1124b70d-console-oauth-config\") pod \"console-58f575999-6hpvx\" (UID: \"a9ff9839-b9c0-463c-8969-906a1124b70d\") " pod="openshift-console/console-58f575999-6hpvx" Jul 23 22:25:44.667102 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:44.666919 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a9ff9839-b9c0-463c-8969-906a1124b70d-service-ca\") pod \"console-58f575999-6hpvx\" (UID: \"a9ff9839-b9c0-463c-8969-906a1124b70d\") " pod="openshift-console/console-58f575999-6hpvx" Jul 23 22:25:44.667102 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:44.666940 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9ff9839-b9c0-463c-8969-906a1124b70d-trusted-ca-bundle\") pod \"console-58f575999-6hpvx\" (UID: \"a9ff9839-b9c0-463c-8969-906a1124b70d\") " pod="openshift-console/console-58f575999-6hpvx" Jul 23 22:25:44.667523 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:44.667494 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a9ff9839-b9c0-463c-8969-906a1124b70d-oauth-serving-cert\") pod \"console-58f575999-6hpvx\" (UID: \"a9ff9839-b9c0-463c-8969-906a1124b70d\") " pod="openshift-console/console-58f575999-6hpvx" Jul 23 22:25:44.667673 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:44.667653 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a9ff9839-b9c0-463c-8969-906a1124b70d-service-ca\") pod \"console-58f575999-6hpvx\" (UID: \"a9ff9839-b9c0-463c-8969-906a1124b70d\") " pod="openshift-console/console-58f575999-6hpvx" Jul 23 22:25:44.667741 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:44.667681 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a9ff9839-b9c0-463c-8969-906a1124b70d-console-config\") pod \"console-58f575999-6hpvx\" (UID: \"a9ff9839-b9c0-463c-8969-906a1124b70d\") " pod="openshift-console/console-58f575999-6hpvx" Jul 23 22:25:44.667893 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:44.667874 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9ff9839-b9c0-463c-8969-906a1124b70d-trusted-ca-bundle\") pod \"console-58f575999-6hpvx\" (UID: \"a9ff9839-b9c0-463c-8969-906a1124b70d\") " pod="openshift-console/console-58f575999-6hpvx" Jul 23 22:25:44.669532 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:44.669509 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a9ff9839-b9c0-463c-8969-906a1124b70d-console-oauth-config\") pod \"console-58f575999-6hpvx\" (UID: \"a9ff9839-b9c0-463c-8969-906a1124b70d\") " pod="openshift-console/console-58f575999-6hpvx" Jul 23 22:25:44.669591 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:44.669583 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a9ff9839-b9c0-463c-8969-906a1124b70d-console-serving-cert\") pod \"console-58f575999-6hpvx\" (UID: \"a9ff9839-b9c0-463c-8969-906a1124b70d\") " pod="openshift-console/console-58f575999-6hpvx" Jul 23 22:25:44.675671 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:44.675648 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2dbr\" (UniqueName: \"kubernetes.io/projected/a9ff9839-b9c0-463c-8969-906a1124b70d-kube-api-access-n2dbr\") pod \"console-58f575999-6hpvx\" (UID: \"a9ff9839-b9c0-463c-8969-906a1124b70d\") " pod="openshift-console/console-58f575999-6hpvx" Jul 23 22:25:44.761715 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:44.761624 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58f575999-6hpvx" Jul 23 22:25:44.889363 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:44.889330 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58f575999-6hpvx"] Jul 23 22:25:44.892389 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:25:44.892366 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9ff9839_b9c0_463c_8969_906a1124b70d.slice/crio-cd49e3e189198508ff952add6e575fd4b99ddf470b45563f7d925a809fc73734 WatchSource:0}: Error finding container cd49e3e189198508ff952add6e575fd4b99ddf470b45563f7d925a809fc73734: Status 404 returned error can't find the container with id cd49e3e189198508ff952add6e575fd4b99ddf470b45563f7d925a809fc73734 Jul 23 22:25:45.582210 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:45.582170 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58f575999-6hpvx" event={"ID":"a9ff9839-b9c0-463c-8969-906a1124b70d","Type":"ContainerStarted","Data":"2bd3923d565905e388d469f4777c6f115630d022f910e37295e33d27f331bf37"} Jul 23 22:25:45.582363 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:45.582254 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58f575999-6hpvx" event={"ID":"a9ff9839-b9c0-463c-8969-906a1124b70d","Type":"ContainerStarted","Data":"cd49e3e189198508ff952add6e575fd4b99ddf470b45563f7d925a809fc73734"} Jul 23 22:25:45.601808 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:45.601744 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-58f575999-6hpvx" podStartSLOduration=1.601727682 podStartE2EDuration="1.601727682s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 22:25:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:25:45.600300767 +0000 UTC m=+173.320298052" watchObservedRunningTime="2026-07-23 22:25:45.601727682 +0000 UTC m=+173.321724941" Jul 23 22:25:54.762267 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:54.762228 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-58f575999-6hpvx" Jul 23 22:25:54.762652 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:54.762291 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-58f575999-6hpvx" Jul 23 22:25:54.766834 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:54.766814 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-58f575999-6hpvx" Jul 23 22:25:55.622389 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:55.622355 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-58f575999-6hpvx" Jul 23 22:25:55.671953 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:55.671924 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b66884f7-qlct5"] Jul 23 22:25:55.773216 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:55.773184 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:25:55.875072 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:55.874992 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:25:55.932302 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:25:55.932279 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:26:01.479388 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:01.479356 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:26:01.578965 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:01.578938 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:26:02.338780 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:02.338751 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lqcqb"] Jul 23 22:26:02.341764 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:02.341747 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lqcqb" Jul 23 22:26:02.344601 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:02.344575 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-lrx59\"" Jul 23 22:26:02.344741 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:02.344715 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 23 22:26:02.345351 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:02.345338 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 23 22:26:02.352900 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:02.352875 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lqcqb"] Jul 23 22:26:02.505391 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:02.505366 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c2528f71-301d-4722-a263-4af2ba2a78cb-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lqcqb\" (UID: \"c2528f71-301d-4722-a263-4af2ba2a78cb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lqcqb" Jul 23 22:26:02.505663 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:02.505404 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wz7t7\" (UniqueName: \"kubernetes.io/projected/c2528f71-301d-4722-a263-4af2ba2a78cb-kube-api-access-wz7t7\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lqcqb\" (UID: \"c2528f71-301d-4722-a263-4af2ba2a78cb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lqcqb" Jul 23 22:26:02.505663 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:02.505455 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c2528f71-301d-4722-a263-4af2ba2a78cb-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lqcqb\" (UID: \"c2528f71-301d-4722-a263-4af2ba2a78cb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lqcqb" Jul 23 22:26:02.606576 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:02.606524 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c2528f71-301d-4722-a263-4af2ba2a78cb-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lqcqb\" (UID: \"c2528f71-301d-4722-a263-4af2ba2a78cb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lqcqb" Jul 23 22:26:02.606576 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:02.606566 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wz7t7\" (UniqueName: \"kubernetes.io/projected/c2528f71-301d-4722-a263-4af2ba2a78cb-kube-api-access-wz7t7\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lqcqb\" (UID: \"c2528f71-301d-4722-a263-4af2ba2a78cb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lqcqb" Jul 23 22:26:02.606729 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:02.606599 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c2528f71-301d-4722-a263-4af2ba2a78cb-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lqcqb\" (UID: \"c2528f71-301d-4722-a263-4af2ba2a78cb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lqcqb" Jul 23 22:26:02.606905 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:02.606887 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c2528f71-301d-4722-a263-4af2ba2a78cb-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lqcqb\" (UID: \"c2528f71-301d-4722-a263-4af2ba2a78cb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lqcqb" Jul 23 22:26:02.606905 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:02.606902 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c2528f71-301d-4722-a263-4af2ba2a78cb-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lqcqb\" (UID: \"c2528f71-301d-4722-a263-4af2ba2a78cb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lqcqb" Jul 23 22:26:02.615834 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:02.615810 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wz7t7\" (UniqueName: \"kubernetes.io/projected/c2528f71-301d-4722-a263-4af2ba2a78cb-kube-api-access-wz7t7\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lqcqb\" (UID: \"c2528f71-301d-4722-a263-4af2ba2a78cb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lqcqb" Jul 23 22:26:02.650113 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:02.650093 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lqcqb" Jul 23 22:26:02.781286 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:02.781264 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lqcqb"] Jul 23 22:26:02.783404 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:26:02.783373 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2528f71_301d_4722_a263_4af2ba2a78cb.slice/crio-06c04def2372754d634b7d67c2bddec29f16f6b20c6a05bc16fd4713031e681f WatchSource:0}: Error finding container 06c04def2372754d634b7d67c2bddec29f16f6b20c6a05bc16fd4713031e681f: Status 404 returned error can't find the container with id 06c04def2372754d634b7d67c2bddec29f16f6b20c6a05bc16fd4713031e681f Jul 23 22:26:03.647038 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:03.646990 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lqcqb" event={"ID":"c2528f71-301d-4722-a263-4af2ba2a78cb","Type":"ContainerStarted","Data":"06c04def2372754d634b7d67c2bddec29f16f6b20c6a05bc16fd4713031e681f"} Jul 23 22:26:08.641395 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:08.641366 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:26:08.667513 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:08.667464 2575 generic.go:356] "Generic (PLEG): container finished" podID="c2528f71-301d-4722-a263-4af2ba2a78cb" containerID="be83f84e512f25eb024549a7e90d96147340fc5b81d63e2d4c7a3956e6d9561a" exitCode=0 Jul 23 22:26:08.667598 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:08.667511 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lqcqb" event={"ID":"c2528f71-301d-4722-a263-4af2ba2a78cb","Type":"ContainerDied","Data":"be83f84e512f25eb024549a7e90d96147340fc5b81d63e2d4c7a3956e6d9561a"} Jul 23 22:26:11.680550 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:11.680520 2575 generic.go:356] "Generic (PLEG): container finished" podID="c2528f71-301d-4722-a263-4af2ba2a78cb" containerID="c572d33d080701a076daf821c8cc5e6e8d3786e48f2ff1e2cd324c5b2294f3ee" exitCode=0 Jul 23 22:26:11.680884 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:11.680590 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lqcqb" event={"ID":"c2528f71-301d-4722-a263-4af2ba2a78cb","Type":"ContainerDied","Data":"c572d33d080701a076daf821c8cc5e6e8d3786e48f2ff1e2cd324c5b2294f3ee"} Jul 23 22:26:18.711080 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:18.711044 2575 generic.go:356] "Generic (PLEG): container finished" podID="c2528f71-301d-4722-a263-4af2ba2a78cb" containerID="af6338df22aacd6725ac07856bf4c1f3c7918cce62c87195318f8e3c21881d7d" exitCode=0 Jul 23 22:26:18.711421 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:18.711108 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lqcqb" event={"ID":"c2528f71-301d-4722-a263-4af2ba2a78cb","Type":"ContainerDied","Data":"af6338df22aacd6725ac07856bf4c1f3c7918cce62c87195318f8e3c21881d7d"} Jul 23 22:26:19.844625 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:19.844601 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lqcqb" Jul 23 22:26:19.937080 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:19.937056 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c2528f71-301d-4722-a263-4af2ba2a78cb-bundle\") pod \"c2528f71-301d-4722-a263-4af2ba2a78cb\" (UID: \"c2528f71-301d-4722-a263-4af2ba2a78cb\") " Jul 23 22:26:19.937203 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:19.937102 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wz7t7\" (UniqueName: \"kubernetes.io/projected/c2528f71-301d-4722-a263-4af2ba2a78cb-kube-api-access-wz7t7\") pod \"c2528f71-301d-4722-a263-4af2ba2a78cb\" (UID: \"c2528f71-301d-4722-a263-4af2ba2a78cb\") " Jul 23 22:26:19.937203 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:19.937135 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c2528f71-301d-4722-a263-4af2ba2a78cb-util\") pod \"c2528f71-301d-4722-a263-4af2ba2a78cb\" (UID: \"c2528f71-301d-4722-a263-4af2ba2a78cb\") " Jul 23 22:26:19.937722 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:19.937696 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2528f71-301d-4722-a263-4af2ba2a78cb-bundle" (OuterVolumeSpecName: "bundle") pod "c2528f71-301d-4722-a263-4af2ba2a78cb" (UID: "c2528f71-301d-4722-a263-4af2ba2a78cb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 22:26:19.939058 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:19.939034 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2528f71-301d-4722-a263-4af2ba2a78cb-kube-api-access-wz7t7" (OuterVolumeSpecName: "kube-api-access-wz7t7") pod "c2528f71-301d-4722-a263-4af2ba2a78cb" (UID: "c2528f71-301d-4722-a263-4af2ba2a78cb"). InnerVolumeSpecName "kube-api-access-wz7t7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 22:26:19.941363 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:19.941336 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2528f71-301d-4722-a263-4af2ba2a78cb-util" (OuterVolumeSpecName: "util") pod "c2528f71-301d-4722-a263-4af2ba2a78cb" (UID: "c2528f71-301d-4722-a263-4af2ba2a78cb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 22:26:20.038168 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:20.038120 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wz7t7\" (UniqueName: \"kubernetes.io/projected/c2528f71-301d-4722-a263-4af2ba2a78cb-kube-api-access-wz7t7\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 22:26:20.038168 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:20.038140 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c2528f71-301d-4722-a263-4af2ba2a78cb-util\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 22:26:20.038168 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:20.038150 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c2528f71-301d-4722-a263-4af2ba2a78cb-bundle\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 22:26:20.691779 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:20.691739 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-b66884f7-qlct5" podUID="e643c7ad-06fd-426c-8181-1cf5ccf558b2" containerName="console" containerID="cri-o://4f6e455e99f369c20fd7e40f950802484f85db4ead083368187411a31ecc5ba7" gracePeriod=15 Jul 23 22:26:20.719752 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:20.719730 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lqcqb" Jul 23 22:26:20.719855 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:20.719725 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lqcqb" event={"ID":"c2528f71-301d-4722-a263-4af2ba2a78cb","Type":"ContainerDied","Data":"06c04def2372754d634b7d67c2bddec29f16f6b20c6a05bc16fd4713031e681f"} Jul 23 22:26:20.719855 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:20.719846 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="06c04def2372754d634b7d67c2bddec29f16f6b20c6a05bc16fd4713031e681f" Jul 23 22:26:20.933651 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:20.933631 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b66884f7-qlct5" Jul 23 22:26:21.045445 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:21.045361 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e643c7ad-06fd-426c-8181-1cf5ccf558b2-console-oauth-config\") pod \"e643c7ad-06fd-426c-8181-1cf5ccf558b2\" (UID: \"e643c7ad-06fd-426c-8181-1cf5ccf558b2\") " Jul 23 22:26:21.045445 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:21.045398 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dw7qh\" (UniqueName: \"kubernetes.io/projected/e643c7ad-06fd-426c-8181-1cf5ccf558b2-kube-api-access-dw7qh\") pod \"e643c7ad-06fd-426c-8181-1cf5ccf558b2\" (UID: \"e643c7ad-06fd-426c-8181-1cf5ccf558b2\") " Jul 23 22:26:21.045445 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:21.045440 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e643c7ad-06fd-426c-8181-1cf5ccf558b2-console-serving-cert\") pod \"e643c7ad-06fd-426c-8181-1cf5ccf558b2\" (UID: \"e643c7ad-06fd-426c-8181-1cf5ccf558b2\") " Jul 23 22:26:21.045706 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:21.045472 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e643c7ad-06fd-426c-8181-1cf5ccf558b2-trusted-ca-bundle\") pod \"e643c7ad-06fd-426c-8181-1cf5ccf558b2\" (UID: \"e643c7ad-06fd-426c-8181-1cf5ccf558b2\") " Jul 23 22:26:21.045706 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:21.045507 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e643c7ad-06fd-426c-8181-1cf5ccf558b2-service-ca\") pod \"e643c7ad-06fd-426c-8181-1cf5ccf558b2\" (UID: \"e643c7ad-06fd-426c-8181-1cf5ccf558b2\") " Jul 23 22:26:21.045706 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:21.045552 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e643c7ad-06fd-426c-8181-1cf5ccf558b2-console-config\") pod \"e643c7ad-06fd-426c-8181-1cf5ccf558b2\" (UID: \"e643c7ad-06fd-426c-8181-1cf5ccf558b2\") " Jul 23 22:26:21.045706 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:21.045586 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e643c7ad-06fd-426c-8181-1cf5ccf558b2-oauth-serving-cert\") pod \"e643c7ad-06fd-426c-8181-1cf5ccf558b2\" (UID: \"e643c7ad-06fd-426c-8181-1cf5ccf558b2\") " Jul 23 22:26:21.045952 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:21.045924 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e643c7ad-06fd-426c-8181-1cf5ccf558b2-service-ca" (OuterVolumeSpecName: "service-ca") pod "e643c7ad-06fd-426c-8181-1cf5ccf558b2" (UID: "e643c7ad-06fd-426c-8181-1cf5ccf558b2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 22:26:21.046054 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:21.045936 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e643c7ad-06fd-426c-8181-1cf5ccf558b2-console-config" (OuterVolumeSpecName: "console-config") pod "e643c7ad-06fd-426c-8181-1cf5ccf558b2" (UID: "e643c7ad-06fd-426c-8181-1cf5ccf558b2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 22:26:21.046054 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:21.045942 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e643c7ad-06fd-426c-8181-1cf5ccf558b2-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e643c7ad-06fd-426c-8181-1cf5ccf558b2" (UID: "e643c7ad-06fd-426c-8181-1cf5ccf558b2"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 22:26:21.046054 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:21.045972 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e643c7ad-06fd-426c-8181-1cf5ccf558b2-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e643c7ad-06fd-426c-8181-1cf5ccf558b2" (UID: "e643c7ad-06fd-426c-8181-1cf5ccf558b2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 22:26:21.046209 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:21.046155 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e643c7ad-06fd-426c-8181-1cf5ccf558b2-console-config\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 22:26:21.046209 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:21.046173 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e643c7ad-06fd-426c-8181-1cf5ccf558b2-oauth-serving-cert\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 22:26:21.046209 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:21.046184 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e643c7ad-06fd-426c-8181-1cf5ccf558b2-trusted-ca-bundle\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 22:26:21.046209 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:21.046192 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e643c7ad-06fd-426c-8181-1cf5ccf558b2-service-ca\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 22:26:21.047626 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:21.047594 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e643c7ad-06fd-426c-8181-1cf5ccf558b2-kube-api-access-dw7qh" (OuterVolumeSpecName: "kube-api-access-dw7qh") pod "e643c7ad-06fd-426c-8181-1cf5ccf558b2" (UID: "e643c7ad-06fd-426c-8181-1cf5ccf558b2"). InnerVolumeSpecName "kube-api-access-dw7qh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 22:26:21.047626 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:21.047622 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e643c7ad-06fd-426c-8181-1cf5ccf558b2-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e643c7ad-06fd-426c-8181-1cf5ccf558b2" (UID: "e643c7ad-06fd-426c-8181-1cf5ccf558b2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 22:26:21.047747 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:21.047604 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e643c7ad-06fd-426c-8181-1cf5ccf558b2-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e643c7ad-06fd-426c-8181-1cf5ccf558b2" (UID: "e643c7ad-06fd-426c-8181-1cf5ccf558b2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 22:26:21.146838 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:21.146809 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e643c7ad-06fd-426c-8181-1cf5ccf558b2-console-oauth-config\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 22:26:21.146838 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:21.146833 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dw7qh\" (UniqueName: \"kubernetes.io/projected/e643c7ad-06fd-426c-8181-1cf5ccf558b2-kube-api-access-dw7qh\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 22:26:21.146838 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:21.146842 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e643c7ad-06fd-426c-8181-1cf5ccf558b2-console-serving-cert\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 22:26:21.724503 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:21.724468 2575 generic.go:356] "Generic (PLEG): container finished" podID="e643c7ad-06fd-426c-8181-1cf5ccf558b2" containerID="4f6e455e99f369c20fd7e40f950802484f85db4ead083368187411a31ecc5ba7" exitCode=0 Jul 23 22:26:21.724671 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:21.724517 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b66884f7-qlct5" Jul 23 22:26:21.724671 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:21.724546 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b66884f7-qlct5" event={"ID":"e643c7ad-06fd-426c-8181-1cf5ccf558b2","Type":"ContainerDied","Data":"4f6e455e99f369c20fd7e40f950802484f85db4ead083368187411a31ecc5ba7"} Jul 23 22:26:21.724671 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:21.724586 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b66884f7-qlct5" event={"ID":"e643c7ad-06fd-426c-8181-1cf5ccf558b2","Type":"ContainerDied","Data":"ea53fedbcbbdaf0998a23730d6ed147911d6bdc35ea404ef7851291e1ecf43be"} Jul 23 22:26:21.724671 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:21.724608 2575 scope.go:117] "RemoveContainer" containerID="4f6e455e99f369c20fd7e40f950802484f85db4ead083368187411a31ecc5ba7" Jul 23 22:26:21.732626 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:21.732608 2575 scope.go:117] "RemoveContainer" containerID="4f6e455e99f369c20fd7e40f950802484f85db4ead083368187411a31ecc5ba7" Jul 23 22:26:21.732884 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:26:21.732865 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f6e455e99f369c20fd7e40f950802484f85db4ead083368187411a31ecc5ba7\": container with ID starting with 4f6e455e99f369c20fd7e40f950802484f85db4ead083368187411a31ecc5ba7 not found: ID does not exist" containerID="4f6e455e99f369c20fd7e40f950802484f85db4ead083368187411a31ecc5ba7" Jul 23 22:26:21.732943 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:21.732892 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f6e455e99f369c20fd7e40f950802484f85db4ead083368187411a31ecc5ba7"} err="failed to get container status \"4f6e455e99f369c20fd7e40f950802484f85db4ead083368187411a31ecc5ba7\": rpc error: code = NotFound desc = could not find container \"4f6e455e99f369c20fd7e40f950802484f85db4ead083368187411a31ecc5ba7\": container with ID starting with 4f6e455e99f369c20fd7e40f950802484f85db4ead083368187411a31ecc5ba7 not found: ID does not exist" Jul 23 22:26:21.746278 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:21.746257 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b66884f7-qlct5"] Jul 23 22:26:21.749290 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:21.749271 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-b66884f7-qlct5"] Jul 23 22:26:22.808055 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:22.807079 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e643c7ad-06fd-426c-8181-1cf5ccf558b2" path="/var/lib/kubelet/pods/e643c7ad-06fd-426c-8181-1cf5ccf558b2/volumes" Jul 23 22:26:23.364439 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:23.364396 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:26:24.359550 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:24.359516 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:26:25.431469 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:25.431434 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pqt9n"] Jul 23 22:26:25.431907 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:25.431831 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2528f71-301d-4722-a263-4af2ba2a78cb" containerName="util" Jul 23 22:26:25.431907 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:25.431849 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2528f71-301d-4722-a263-4af2ba2a78cb" containerName="util" Jul 23 22:26:25.431907 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:25.431864 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e643c7ad-06fd-426c-8181-1cf5ccf558b2" containerName="console" Jul 23 22:26:25.431907 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:25.431871 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e643c7ad-06fd-426c-8181-1cf5ccf558b2" containerName="console" Jul 23 22:26:25.431907 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:25.431888 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2528f71-301d-4722-a263-4af2ba2a78cb" containerName="extract" Jul 23 22:26:25.431907 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:25.431896 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2528f71-301d-4722-a263-4af2ba2a78cb" containerName="extract" Jul 23 22:26:25.432263 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:25.431915 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2528f71-301d-4722-a263-4af2ba2a78cb" containerName="pull" Jul 23 22:26:25.432263 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:25.431922 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2528f71-301d-4722-a263-4af2ba2a78cb" containerName="pull" Jul 23 22:26:25.432263 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:25.431992 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2528f71-301d-4722-a263-4af2ba2a78cb" containerName="extract" Jul 23 22:26:25.432263 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:25.432002 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e643c7ad-06fd-426c-8181-1cf5ccf558b2" containerName="console" Jul 23 22:26:25.436496 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:25.436473 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pqt9n" Jul 23 22:26:25.438890 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:25.438866 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 23 22:26:25.439005 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:25.438939 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 23 22:26:25.439083 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:25.439035 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-vl6vn\"" Jul 23 22:26:25.450324 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:25.450303 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pqt9n"] Jul 23 22:26:25.479819 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:25.479796 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zk95n\" (UniqueName: \"kubernetes.io/projected/e95d4d2e-775f-40f3-b51a-270010636725-kube-api-access-zk95n\") pod \"cert-manager-operator-controller-manager-55c444bf86-pqt9n\" (UID: \"e95d4d2e-775f-40f3-b51a-270010636725\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pqt9n" Jul 23 22:26:25.479933 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:25.479849 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e95d4d2e-775f-40f3-b51a-270010636725-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-pqt9n\" (UID: \"e95d4d2e-775f-40f3-b51a-270010636725\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pqt9n" Jul 23 22:26:25.580317 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:25.580292 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zk95n\" (UniqueName: \"kubernetes.io/projected/e95d4d2e-775f-40f3-b51a-270010636725-kube-api-access-zk95n\") pod \"cert-manager-operator-controller-manager-55c444bf86-pqt9n\" (UID: \"e95d4d2e-775f-40f3-b51a-270010636725\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pqt9n" Jul 23 22:26:25.580403 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:25.580344 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e95d4d2e-775f-40f3-b51a-270010636725-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-pqt9n\" (UID: \"e95d4d2e-775f-40f3-b51a-270010636725\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pqt9n" Jul 23 22:26:25.580675 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:25.580661 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e95d4d2e-775f-40f3-b51a-270010636725-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-pqt9n\" (UID: \"e95d4d2e-775f-40f3-b51a-270010636725\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pqt9n" Jul 23 22:26:25.602051 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:25.602011 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zk95n\" (UniqueName: \"kubernetes.io/projected/e95d4d2e-775f-40f3-b51a-270010636725-kube-api-access-zk95n\") pod \"cert-manager-operator-controller-manager-55c444bf86-pqt9n\" (UID: \"e95d4d2e-775f-40f3-b51a-270010636725\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pqt9n" Jul 23 22:26:25.745221 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:25.745174 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pqt9n" Jul 23 22:26:25.873064 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:25.873037 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pqt9n"] Jul 23 22:26:25.875537 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:26:25.875510 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode95d4d2e_775f_40f3_b51a_270010636725.slice/crio-f18445211d6d6f256efde083e068aae8664e19f51de6babc403866814d727dc2 WatchSource:0}: Error finding container f18445211d6d6f256efde083e068aae8664e19f51de6babc403866814d727dc2: Status 404 returned error can't find the container with id f18445211d6d6f256efde083e068aae8664e19f51de6babc403866814d727dc2 Jul 23 22:26:26.748203 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:26.748131 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pqt9n" event={"ID":"e95d4d2e-775f-40f3-b51a-270010636725","Type":"ContainerStarted","Data":"f18445211d6d6f256efde083e068aae8664e19f51de6babc403866814d727dc2"} Jul 23 22:26:26.980816 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:26.980754 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:26:27.081777 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:27.081675 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:26:27.754684 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:27.754650 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pqt9n" event={"ID":"e95d4d2e-775f-40f3-b51a-270010636725","Type":"ContainerStarted","Data":"ef8a321aa8fec0156fcf95b97170a29d9f219ec7d36e2583a40f79b0da221ad7"} Jul 23 22:26:27.783007 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:27.782961 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pqt9n" podStartSLOduration=1.1071189399999999 podStartE2EDuration="2.782942463s" totalImagesPullingTime="1.675823523s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 22:26:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:26:27.782053686 +0000 UTC m=+215.502050940" watchObservedRunningTime="2026-07-23 22:26:27.782942463 +0000 UTC m=+215.502939724" Jul 23 22:26:28.140362 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:28.140335 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:26:28.231837 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:28.231813 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:26:28.436596 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:28.436560 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:26:28.526183 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:28.526156 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:26:28.775767 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:28.775698 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-t7xnq"] Jul 23 22:26:28.777923 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:28.777902 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-t7xnq" Jul 23 22:26:28.780423 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:28.780402 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 23 22:26:28.781273 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:28.781251 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-kh9tc\"" Jul 23 22:26:28.781405 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:28.781255 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 23 22:26:28.788980 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:28.788959 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-t7xnq"] Jul 23 22:26:28.904440 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:28.904396 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmhsq\" (UniqueName: \"kubernetes.io/projected/490ecac7-4c66-45da-b8e9-dfdbd25a2acc-kube-api-access-cmhsq\") pod \"cert-manager-webhook-6486ffd997-t7xnq\" (UID: \"490ecac7-4c66-45da-b8e9-dfdbd25a2acc\") " pod="cert-manager/cert-manager-webhook-6486ffd997-t7xnq" Jul 23 22:26:28.904586 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:28.904464 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/490ecac7-4c66-45da-b8e9-dfdbd25a2acc-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-t7xnq\" (UID: \"490ecac7-4c66-45da-b8e9-dfdbd25a2acc\") " pod="cert-manager/cert-manager-webhook-6486ffd997-t7xnq" Jul 23 22:26:29.005679 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:29.005650 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/490ecac7-4c66-45da-b8e9-dfdbd25a2acc-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-t7xnq\" (UID: \"490ecac7-4c66-45da-b8e9-dfdbd25a2acc\") " pod="cert-manager/cert-manager-webhook-6486ffd997-t7xnq" Jul 23 22:26:29.005796 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:29.005698 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmhsq\" (UniqueName: \"kubernetes.io/projected/490ecac7-4c66-45da-b8e9-dfdbd25a2acc-kube-api-access-cmhsq\") pod \"cert-manager-webhook-6486ffd997-t7xnq\" (UID: \"490ecac7-4c66-45da-b8e9-dfdbd25a2acc\") " pod="cert-manager/cert-manager-webhook-6486ffd997-t7xnq" Jul 23 22:26:29.015691 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:29.015665 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmhsq\" (UniqueName: \"kubernetes.io/projected/490ecac7-4c66-45da-b8e9-dfdbd25a2acc-kube-api-access-cmhsq\") pod \"cert-manager-webhook-6486ffd997-t7xnq\" (UID: \"490ecac7-4c66-45da-b8e9-dfdbd25a2acc\") " pod="cert-manager/cert-manager-webhook-6486ffd997-t7xnq" Jul 23 22:26:29.017412 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:29.017393 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/490ecac7-4c66-45da-b8e9-dfdbd25a2acc-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-t7xnq\" (UID: \"490ecac7-4c66-45da-b8e9-dfdbd25a2acc\") " pod="cert-manager/cert-manager-webhook-6486ffd997-t7xnq" Jul 23 22:26:29.059295 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:29.059232 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg4n5p"] Jul 23 22:26:29.061577 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:29.061561 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg4n5p" Jul 23 22:26:29.066393 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:29.066377 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 23 22:26:29.066906 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:29.066887 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 23 22:26:29.067399 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:29.067378 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-lrx59\"" Jul 23 22:26:29.074903 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:29.074882 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg4n5p"] Jul 23 22:26:29.099701 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:29.099676 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-t7xnq" Jul 23 22:26:29.106396 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:29.106375 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c58d896c-6e43-47d9-a99b-4ec010d574e0-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg4n5p\" (UID: \"c58d896c-6e43-47d9-a99b-4ec010d574e0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg4n5p" Jul 23 22:26:29.106505 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:29.106405 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c58d896c-6e43-47d9-a99b-4ec010d574e0-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg4n5p\" (UID: \"c58d896c-6e43-47d9-a99b-4ec010d574e0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg4n5p" Jul 23 22:26:29.106505 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:29.106427 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhglc\" (UniqueName: \"kubernetes.io/projected/c58d896c-6e43-47d9-a99b-4ec010d574e0-kube-api-access-qhglc\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg4n5p\" (UID: \"c58d896c-6e43-47d9-a99b-4ec010d574e0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg4n5p" Jul 23 22:26:29.207667 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:29.207637 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c58d896c-6e43-47d9-a99b-4ec010d574e0-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg4n5p\" (UID: \"c58d896c-6e43-47d9-a99b-4ec010d574e0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg4n5p" Jul 23 22:26:29.207826 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:29.207677 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c58d896c-6e43-47d9-a99b-4ec010d574e0-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg4n5p\" (UID: \"c58d896c-6e43-47d9-a99b-4ec010d574e0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg4n5p" Jul 23 22:26:29.207826 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:29.207784 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhglc\" (UniqueName: \"kubernetes.io/projected/c58d896c-6e43-47d9-a99b-4ec010d574e0-kube-api-access-qhglc\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg4n5p\" (UID: \"c58d896c-6e43-47d9-a99b-4ec010d574e0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg4n5p" Jul 23 22:26:29.208013 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:29.207994 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c58d896c-6e43-47d9-a99b-4ec010d574e0-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg4n5p\" (UID: \"c58d896c-6e43-47d9-a99b-4ec010d574e0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg4n5p" Jul 23 22:26:29.208147 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:29.208130 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c58d896c-6e43-47d9-a99b-4ec010d574e0-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg4n5p\" (UID: \"c58d896c-6e43-47d9-a99b-4ec010d574e0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg4n5p" Jul 23 22:26:29.216835 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:29.216805 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhglc\" (UniqueName: \"kubernetes.io/projected/c58d896c-6e43-47d9-a99b-4ec010d574e0-kube-api-access-qhglc\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg4n5p\" (UID: \"c58d896c-6e43-47d9-a99b-4ec010d574e0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg4n5p" Jul 23 22:26:29.227488 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:29.227465 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-t7xnq"] Jul 23 22:26:29.229859 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:26:29.229838 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod490ecac7_4c66_45da_b8e9_dfdbd25a2acc.slice/crio-07c7554325b13c749f7afca6a21b46e083d31af2c5b783b77d63ab44e98feb56 WatchSource:0}: Error finding container 07c7554325b13c749f7afca6a21b46e083d31af2c5b783b77d63ab44e98feb56: Status 404 returned error can't find the container with id 07c7554325b13c749f7afca6a21b46e083d31af2c5b783b77d63ab44e98feb56 Jul 23 22:26:29.370777 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:29.370698 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg4n5p" Jul 23 22:26:29.491188 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:29.491153 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg4n5p"] Jul 23 22:26:29.494231 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:26:29.494210 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc58d896c_6e43_47d9_a99b_4ec010d574e0.slice/crio-4dc5ee0c78233fd43f3150a50a16227e27baee47557d23c6a9d9c497123791f5 WatchSource:0}: Error finding container 4dc5ee0c78233fd43f3150a50a16227e27baee47557d23c6a9d9c497123791f5: Status 404 returned error can't find the container with id 4dc5ee0c78233fd43f3150a50a16227e27baee47557d23c6a9d9c497123791f5 Jul 23 22:26:29.764147 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:29.764115 2575 generic.go:356] "Generic (PLEG): container finished" podID="c58d896c-6e43-47d9-a99b-4ec010d574e0" containerID="bf409110cd22d464b2d543a6160c8b6a6583f9ae807c35aa41363a4487a966e2" exitCode=0 Jul 23 22:26:29.764326 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:29.764212 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg4n5p" event={"ID":"c58d896c-6e43-47d9-a99b-4ec010d574e0","Type":"ContainerDied","Data":"bf409110cd22d464b2d543a6160c8b6a6583f9ae807c35aa41363a4487a966e2"} Jul 23 22:26:29.764326 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:29.764283 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg4n5p" event={"ID":"c58d896c-6e43-47d9-a99b-4ec010d574e0","Type":"ContainerStarted","Data":"4dc5ee0c78233fd43f3150a50a16227e27baee47557d23c6a9d9c497123791f5"} Jul 23 22:26:29.765505 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:29.765473 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-t7xnq" event={"ID":"490ecac7-4c66-45da-b8e9-dfdbd25a2acc","Type":"ContainerStarted","Data":"07c7554325b13c749f7afca6a21b46e083d31af2c5b783b77d63ab44e98feb56"} Jul 23 22:26:30.808325 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:30.807877 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:26:31.056790 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:31.056691 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:26:31.090127 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:31.090042 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-984l9"] Jul 23 22:26:31.092908 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:31.092884 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-984l9" Jul 23 22:26:31.096766 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:31.096667 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-dfs8m\"" Jul 23 22:26:31.115744 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:31.115718 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-984l9"] Jul 23 22:26:31.225326 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:31.225289 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjkzt\" (UniqueName: \"kubernetes.io/projected/5f144fa9-cd27-4563-a745-b80219c0f1e7-kube-api-access-wjkzt\") pod \"cert-manager-cainjector-559cdd8c87-984l9\" (UID: \"5f144fa9-cd27-4563-a745-b80219c0f1e7\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-984l9" Jul 23 22:26:31.225568 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:31.225371 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5f144fa9-cd27-4563-a745-b80219c0f1e7-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-984l9\" (UID: \"5f144fa9-cd27-4563-a745-b80219c0f1e7\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-984l9" Jul 23 22:26:31.326704 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:31.326648 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5f144fa9-cd27-4563-a745-b80219c0f1e7-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-984l9\" (UID: \"5f144fa9-cd27-4563-a745-b80219c0f1e7\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-984l9" Jul 23 22:26:31.326892 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:31.326742 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjkzt\" (UniqueName: \"kubernetes.io/projected/5f144fa9-cd27-4563-a745-b80219c0f1e7-kube-api-access-wjkzt\") pod \"cert-manager-cainjector-559cdd8c87-984l9\" (UID: \"5f144fa9-cd27-4563-a745-b80219c0f1e7\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-984l9" Jul 23 22:26:31.340961 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:31.338944 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjkzt\" (UniqueName: \"kubernetes.io/projected/5f144fa9-cd27-4563-a745-b80219c0f1e7-kube-api-access-wjkzt\") pod \"cert-manager-cainjector-559cdd8c87-984l9\" (UID: \"5f144fa9-cd27-4563-a745-b80219c0f1e7\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-984l9" Jul 23 22:26:31.341677 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:31.341648 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5f144fa9-cd27-4563-a745-b80219c0f1e7-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-984l9\" (UID: \"5f144fa9-cd27-4563-a745-b80219c0f1e7\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-984l9" Jul 23 22:26:31.406365 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:31.406337 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-984l9" Jul 23 22:26:32.778472 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:32.778273 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-984l9"] Jul 23 22:26:32.782084 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:26:32.782051 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5f144fa9_cd27_4563_a745_b80219c0f1e7.slice/crio-65660061ce098a9e129cc18a4ef395d9ccc3e56badc8c5fd9e95e6e849cdbce3 WatchSource:0}: Error finding container 65660061ce098a9e129cc18a4ef395d9ccc3e56badc8c5fd9e95e6e849cdbce3: Status 404 returned error can't find the container with id 65660061ce098a9e129cc18a4ef395d9ccc3e56badc8c5fd9e95e6e849cdbce3 Jul 23 22:26:32.785924 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:32.785784 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg4n5p" event={"ID":"c58d896c-6e43-47d9-a99b-4ec010d574e0","Type":"ContainerStarted","Data":"61b1d9c362bd960157a27730a5a33dacc759764a308e125344fe886b0d335376"} Jul 23 22:26:32.787757 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:32.787607 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-t7xnq" event={"ID":"490ecac7-4c66-45da-b8e9-dfdbd25a2acc","Type":"ContainerStarted","Data":"c2e6933e95a181acdef16b0666b0328842c993198e42917844e6636dfa8c4586"} Jul 23 22:26:32.788155 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:32.788136 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-t7xnq" Jul 23 22:26:32.843617 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:32.843572 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-t7xnq" podStartSLOduration=1.4360177379999999 podStartE2EDuration="4.843557447s" totalImagesPullingTime="3.407539709s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 22:26:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:26:32.842870136 +0000 UTC m=+220.562867409" watchObservedRunningTime="2026-07-23 22:26:32.843557447 +0000 UTC m=+220.563554707" Jul 23 22:26:33.770096 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:33.770064 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:26:33.792850 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:33.792817 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-984l9" event={"ID":"5f144fa9-cd27-4563-a745-b80219c0f1e7","Type":"ContainerStarted","Data":"9a0dd60c105c9e9b4f5b6ae147e836d5939b320514f8ecc1802b3365ee3c15da"} Jul 23 22:26:33.793209 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:33.792863 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-984l9" event={"ID":"5f144fa9-cd27-4563-a745-b80219c0f1e7","Type":"ContainerStarted","Data":"65660061ce098a9e129cc18a4ef395d9ccc3e56badc8c5fd9e95e6e849cdbce3"} Jul 23 22:26:33.794583 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:33.794560 2575 generic.go:356] "Generic (PLEG): container finished" podID="c58d896c-6e43-47d9-a99b-4ec010d574e0" containerID="61b1d9c362bd960157a27730a5a33dacc759764a308e125344fe886b0d335376" exitCode=0 Jul 23 22:26:33.794676 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:33.794638 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg4n5p" event={"ID":"c58d896c-6e43-47d9-a99b-4ec010d574e0","Type":"ContainerDied","Data":"61b1d9c362bd960157a27730a5a33dacc759764a308e125344fe886b0d335376"} Jul 23 22:26:33.813716 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:33.813678 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-984l9" podStartSLOduration=2.813666121 podStartE2EDuration="2.813666121s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 22:26:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:26:33.812088683 +0000 UTC m=+221.532085945" watchObservedRunningTime="2026-07-23 22:26:33.813666121 +0000 UTC m=+221.533663380" Jul 23 22:26:33.836770 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:33.836747 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:26:34.801438 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:34.801404 2575 generic.go:356] "Generic (PLEG): container finished" podID="c58d896c-6e43-47d9-a99b-4ec010d574e0" containerID="7903cb8929d1336663474ff30958f3a769f9c9769abeeaf89bd77d793a7a65b3" exitCode=0 Jul 23 22:26:34.806118 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:34.806087 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg4n5p" event={"ID":"c58d896c-6e43-47d9-a99b-4ec010d574e0","Type":"ContainerDied","Data":"7903cb8929d1336663474ff30958f3a769f9c9769abeeaf89bd77d793a7a65b3"} Jul 23 22:26:35.926517 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:35.926498 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg4n5p" Jul 23 22:26:36.065120 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:36.065066 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qhglc\" (UniqueName: \"kubernetes.io/projected/c58d896c-6e43-47d9-a99b-4ec010d574e0-kube-api-access-qhglc\") pod \"c58d896c-6e43-47d9-a99b-4ec010d574e0\" (UID: \"c58d896c-6e43-47d9-a99b-4ec010d574e0\") " Jul 23 22:26:36.065120 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:36.065116 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c58d896c-6e43-47d9-a99b-4ec010d574e0-bundle\") pod \"c58d896c-6e43-47d9-a99b-4ec010d574e0\" (UID: \"c58d896c-6e43-47d9-a99b-4ec010d574e0\") " Jul 23 22:26:36.065294 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:36.065143 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c58d896c-6e43-47d9-a99b-4ec010d574e0-util\") pod \"c58d896c-6e43-47d9-a99b-4ec010d574e0\" (UID: \"c58d896c-6e43-47d9-a99b-4ec010d574e0\") " Jul 23 22:26:36.065509 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:36.065487 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c58d896c-6e43-47d9-a99b-4ec010d574e0-bundle" (OuterVolumeSpecName: "bundle") pod "c58d896c-6e43-47d9-a99b-4ec010d574e0" (UID: "c58d896c-6e43-47d9-a99b-4ec010d574e0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 22:26:36.066980 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:36.066958 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c58d896c-6e43-47d9-a99b-4ec010d574e0-kube-api-access-qhglc" (OuterVolumeSpecName: "kube-api-access-qhglc") pod "c58d896c-6e43-47d9-a99b-4ec010d574e0" (UID: "c58d896c-6e43-47d9-a99b-4ec010d574e0"). InnerVolumeSpecName "kube-api-access-qhglc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 22:26:36.069329 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:36.069297 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c58d896c-6e43-47d9-a99b-4ec010d574e0-util" (OuterVolumeSpecName: "util") pod "c58d896c-6e43-47d9-a99b-4ec010d574e0" (UID: "c58d896c-6e43-47d9-a99b-4ec010d574e0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 22:26:36.166268 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:36.166246 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qhglc\" (UniqueName: \"kubernetes.io/projected/c58d896c-6e43-47d9-a99b-4ec010d574e0-kube-api-access-qhglc\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 22:26:36.166268 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:36.166267 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c58d896c-6e43-47d9-a99b-4ec010d574e0-bundle\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 22:26:36.166368 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:36.166277 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c58d896c-6e43-47d9-a99b-4ec010d574e0-util\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 22:26:36.811526 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:36.811488 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg4n5p" event={"ID":"c58d896c-6e43-47d9-a99b-4ec010d574e0","Type":"ContainerDied","Data":"4dc5ee0c78233fd43f3150a50a16227e27baee47557d23c6a9d9c497123791f5"} Jul 23 22:26:36.811724 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:36.811537 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4dc5ee0c78233fd43f3150a50a16227e27baee47557d23c6a9d9c497123791f5" Jul 23 22:26:36.811724 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:36.811538 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg4n5p" Jul 23 22:26:38.053442 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:38.053408 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:26:39.803362 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:39.803336 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-t7xnq" Jul 23 22:26:44.976967 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:44.976934 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:26:45.076424 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:45.076398 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:26:50.923937 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:50.923903 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:26:51.021621 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:51.021600 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:26:53.058049 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:53.057996 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjlhvh"] Jul 23 22:26:53.058432 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:53.058394 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c58d896c-6e43-47d9-a99b-4ec010d574e0" containerName="extract" Jul 23 22:26:53.058432 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:53.058412 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c58d896c-6e43-47d9-a99b-4ec010d574e0" containerName="extract" Jul 23 22:26:53.058432 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:53.058430 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c58d896c-6e43-47d9-a99b-4ec010d574e0" containerName="util" Jul 23 22:26:53.058585 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:53.058438 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c58d896c-6e43-47d9-a99b-4ec010d574e0" containerName="util" Jul 23 22:26:53.058585 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:53.058464 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c58d896c-6e43-47d9-a99b-4ec010d574e0" containerName="pull" Jul 23 22:26:53.058585 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:53.058472 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c58d896c-6e43-47d9-a99b-4ec010d574e0" containerName="pull" Jul 23 22:26:53.058585 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:53.058538 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="c58d896c-6e43-47d9-a99b-4ec010d574e0" containerName="extract" Jul 23 22:26:53.087427 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:53.087403 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjlhvh" Jul 23 22:26:53.087547 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:53.087409 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjlhvh"] Jul 23 22:26:53.090547 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:53.090527 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 23 22:26:53.091350 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:53.091334 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-lrx59\"" Jul 23 22:26:53.091350 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:53.091343 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 23 22:26:53.176035 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:53.175990 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwww8\" (UniqueName: \"kubernetes.io/projected/e94e4836-afdf-4f7e-86d8-05abab8aaa7b-kube-api-access-jwww8\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjlhvh\" (UID: \"e94e4836-afdf-4f7e-86d8-05abab8aaa7b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjlhvh" Jul 23 22:26:53.176134 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:53.176072 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e94e4836-afdf-4f7e-86d8-05abab8aaa7b-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjlhvh\" (UID: \"e94e4836-afdf-4f7e-86d8-05abab8aaa7b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjlhvh" Jul 23 22:26:53.176134 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:53.176098 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e94e4836-afdf-4f7e-86d8-05abab8aaa7b-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjlhvh\" (UID: \"e94e4836-afdf-4f7e-86d8-05abab8aaa7b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjlhvh" Jul 23 22:26:53.211347 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:53.211325 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:26:53.273887 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:53.273868 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:26:53.276890 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:53.276869 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwww8\" (UniqueName: \"kubernetes.io/projected/e94e4836-afdf-4f7e-86d8-05abab8aaa7b-kube-api-access-jwww8\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjlhvh\" (UID: \"e94e4836-afdf-4f7e-86d8-05abab8aaa7b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjlhvh" Jul 23 22:26:53.276981 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:53.276908 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e94e4836-afdf-4f7e-86d8-05abab8aaa7b-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjlhvh\" (UID: \"e94e4836-afdf-4f7e-86d8-05abab8aaa7b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjlhvh" Jul 23 22:26:53.276981 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:53.276931 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e94e4836-afdf-4f7e-86d8-05abab8aaa7b-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjlhvh\" (UID: \"e94e4836-afdf-4f7e-86d8-05abab8aaa7b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjlhvh" Jul 23 22:26:53.277301 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:53.277284 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e94e4836-afdf-4f7e-86d8-05abab8aaa7b-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjlhvh\" (UID: \"e94e4836-afdf-4f7e-86d8-05abab8aaa7b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjlhvh" Jul 23 22:26:53.277385 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:53.277297 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e94e4836-afdf-4f7e-86d8-05abab8aaa7b-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjlhvh\" (UID: \"e94e4836-afdf-4f7e-86d8-05abab8aaa7b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjlhvh" Jul 23 22:26:53.284741 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:53.284712 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwww8\" (UniqueName: \"kubernetes.io/projected/e94e4836-afdf-4f7e-86d8-05abab8aaa7b-kube-api-access-jwww8\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjlhvh\" (UID: \"e94e4836-afdf-4f7e-86d8-05abab8aaa7b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjlhvh" Jul 23 22:26:53.396635 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:53.396574 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjlhvh" Jul 23 22:26:53.539964 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:53.539941 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjlhvh"] Jul 23 22:26:53.542162 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:26:53.542136 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode94e4836_afdf_4f7e_86d8_05abab8aaa7b.slice/crio-d98eb9dd001f84e170856268a8777cb9a676ce66b44f1ad2ee5f22ac0e21d90d WatchSource:0}: Error finding container d98eb9dd001f84e170856268a8777cb9a676ce66b44f1ad2ee5f22ac0e21d90d: Status 404 returned error can't find the container with id d98eb9dd001f84e170856268a8777cb9a676ce66b44f1ad2ee5f22ac0e21d90d Jul 23 22:26:53.876281 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:53.876253 2575 generic.go:356] "Generic (PLEG): container finished" podID="e94e4836-afdf-4f7e-86d8-05abab8aaa7b" containerID="884722c544252a4c051884a3906411878c6c40ebe32701129148f503d1861535" exitCode=0 Jul 23 22:26:53.876378 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:53.876305 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjlhvh" event={"ID":"e94e4836-afdf-4f7e-86d8-05abab8aaa7b","Type":"ContainerDied","Data":"884722c544252a4c051884a3906411878c6c40ebe32701129148f503d1861535"} Jul 23 22:26:53.876378 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:53.876334 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjlhvh" event={"ID":"e94e4836-afdf-4f7e-86d8-05abab8aaa7b","Type":"ContainerStarted","Data":"d98eb9dd001f84e170856268a8777cb9a676ce66b44f1ad2ee5f22ac0e21d90d"} Jul 23 22:26:54.881886 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:54.881860 2575 generic.go:356] "Generic (PLEG): container finished" podID="e94e4836-afdf-4f7e-86d8-05abab8aaa7b" containerID="a499cbb7bc96c30ade49be7baf169843bb51058801131b09f0d7801c212005e7" exitCode=0 Jul 23 22:26:54.882199 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:54.881905 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjlhvh" event={"ID":"e94e4836-afdf-4f7e-86d8-05abab8aaa7b","Type":"ContainerDied","Data":"a499cbb7bc96c30ade49be7baf169843bb51058801131b09f0d7801c212005e7"} Jul 23 22:26:55.887676 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:55.887647 2575 generic.go:356] "Generic (PLEG): container finished" podID="e94e4836-afdf-4f7e-86d8-05abab8aaa7b" containerID="1084cb425985fca66dd015087b3e595df01a0f80732c1156dcfcd67265a0093d" exitCode=0 Jul 23 22:26:55.888068 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:55.887690 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjlhvh" event={"ID":"e94e4836-afdf-4f7e-86d8-05abab8aaa7b","Type":"ContainerDied","Data":"1084cb425985fca66dd015087b3e595df01a0f80732c1156dcfcd67265a0093d"} Jul 23 22:26:57.001504 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:57.001479 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjlhvh" Jul 23 22:26:57.104751 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:57.104726 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e94e4836-afdf-4f7e-86d8-05abab8aaa7b-util\") pod \"e94e4836-afdf-4f7e-86d8-05abab8aaa7b\" (UID: \"e94e4836-afdf-4f7e-86d8-05abab8aaa7b\") " Jul 23 22:26:57.104849 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:57.104777 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jwww8\" (UniqueName: \"kubernetes.io/projected/e94e4836-afdf-4f7e-86d8-05abab8aaa7b-kube-api-access-jwww8\") pod \"e94e4836-afdf-4f7e-86d8-05abab8aaa7b\" (UID: \"e94e4836-afdf-4f7e-86d8-05abab8aaa7b\") " Jul 23 22:26:57.104849 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:57.104795 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e94e4836-afdf-4f7e-86d8-05abab8aaa7b-bundle\") pod \"e94e4836-afdf-4f7e-86d8-05abab8aaa7b\" (UID: \"e94e4836-afdf-4f7e-86d8-05abab8aaa7b\") " Jul 23 22:26:57.105536 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:57.105509 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e94e4836-afdf-4f7e-86d8-05abab8aaa7b-bundle" (OuterVolumeSpecName: "bundle") pod "e94e4836-afdf-4f7e-86d8-05abab8aaa7b" (UID: "e94e4836-afdf-4f7e-86d8-05abab8aaa7b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 22:26:57.106621 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:57.106601 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e94e4836-afdf-4f7e-86d8-05abab8aaa7b-kube-api-access-jwww8" (OuterVolumeSpecName: "kube-api-access-jwww8") pod "e94e4836-afdf-4f7e-86d8-05abab8aaa7b" (UID: "e94e4836-afdf-4f7e-86d8-05abab8aaa7b"). InnerVolumeSpecName "kube-api-access-jwww8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 22:26:57.110826 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:57.110805 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e94e4836-afdf-4f7e-86d8-05abab8aaa7b-util" (OuterVolumeSpecName: "util") pod "e94e4836-afdf-4f7e-86d8-05abab8aaa7b" (UID: "e94e4836-afdf-4f7e-86d8-05abab8aaa7b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 22:26:57.206035 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:57.205993 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jwww8\" (UniqueName: \"kubernetes.io/projected/e94e4836-afdf-4f7e-86d8-05abab8aaa7b-kube-api-access-jwww8\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 22:26:57.206121 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:57.206043 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e94e4836-afdf-4f7e-86d8-05abab8aaa7b-bundle\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 22:26:57.206121 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:57.206058 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e94e4836-afdf-4f7e-86d8-05abab8aaa7b-util\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 22:26:57.896937 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:57.896909 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjlhvh" event={"ID":"e94e4836-afdf-4f7e-86d8-05abab8aaa7b","Type":"ContainerDied","Data":"d98eb9dd001f84e170856268a8777cb9a676ce66b44f1ad2ee5f22ac0e21d90d"} Jul 23 22:26:57.896937 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:57.896924 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjlhvh" Jul 23 22:26:57.897116 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:26:57.896944 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d98eb9dd001f84e170856268a8777cb9a676ce66b44f1ad2ee5f22ac0e21d90d" Jul 23 22:27:06.293931 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:06.293899 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:27:08.378195 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:08.378164 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:27:08.476067 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:08.474440 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:27:09.194803 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:09.194780 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:27:09.486061 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:09.485975 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:27:09.600273 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:09.600242 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:27:09.673055 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:09.673013 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-fc7cc8c86-r48dl"] Jul 23 22:27:09.673337 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:09.673325 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e94e4836-afdf-4f7e-86d8-05abab8aaa7b" containerName="util" Jul 23 22:27:09.673381 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:09.673340 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e94e4836-afdf-4f7e-86d8-05abab8aaa7b" containerName="util" Jul 23 22:27:09.673381 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:09.673357 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e94e4836-afdf-4f7e-86d8-05abab8aaa7b" containerName="pull" Jul 23 22:27:09.673381 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:09.673362 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e94e4836-afdf-4f7e-86d8-05abab8aaa7b" containerName="pull" Jul 23 22:27:09.673381 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:09.673369 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e94e4836-afdf-4f7e-86d8-05abab8aaa7b" containerName="extract" Jul 23 22:27:09.673381 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:09.673374 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e94e4836-afdf-4f7e-86d8-05abab8aaa7b" containerName="extract" Jul 23 22:27:09.673527 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:09.673423 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e94e4836-afdf-4f7e-86d8-05abab8aaa7b" containerName="extract" Jul 23 22:27:09.678084 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:09.678068 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-fc7cc8c86-r48dl" Jul 23 22:27:09.682430 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:09.682407 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 23 22:27:09.682554 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:09.682497 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 23 22:27:09.682711 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:09.682694 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 23 22:27:09.682854 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:09.682840 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-5vgr8\"" Jul 23 22:27:09.689341 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:09.689324 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 23 22:27:09.735335 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:09.735312 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-fc7cc8c86-r48dl"] Jul 23 22:27:09.787502 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:09.787427 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ad5ec099-8b13-4413-b074-00439e105408-manifests\") pod \"opendatahub-operator-controller-manager-fc7cc8c86-r48dl\" (UID: \"ad5ec099-8b13-4413-b074-00439e105408\") " pod="opendatahub/opendatahub-operator-controller-manager-fc7cc8c86-r48dl" Jul 23 22:27:09.787502 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:09.787489 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qmtr\" (UniqueName: \"kubernetes.io/projected/ad5ec099-8b13-4413-b074-00439e105408-kube-api-access-9qmtr\") pod \"opendatahub-operator-controller-manager-fc7cc8c86-r48dl\" (UID: \"ad5ec099-8b13-4413-b074-00439e105408\") " pod="opendatahub/opendatahub-operator-controller-manager-fc7cc8c86-r48dl" Jul 23 22:27:09.787632 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:09.787523 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ad5ec099-8b13-4413-b074-00439e105408-tmp\") pod \"opendatahub-operator-controller-manager-fc7cc8c86-r48dl\" (UID: \"ad5ec099-8b13-4413-b074-00439e105408\") " pod="opendatahub/opendatahub-operator-controller-manager-fc7cc8c86-r48dl" Jul 23 22:27:09.787632 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:09.787583 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ad5ec099-8b13-4413-b074-00439e105408-apiservice-cert\") pod \"opendatahub-operator-controller-manager-fc7cc8c86-r48dl\" (UID: \"ad5ec099-8b13-4413-b074-00439e105408\") " pod="opendatahub/opendatahub-operator-controller-manager-fc7cc8c86-r48dl" Jul 23 22:27:09.787632 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:09.787617 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ad5ec099-8b13-4413-b074-00439e105408-webhook-cert\") pod \"opendatahub-operator-controller-manager-fc7cc8c86-r48dl\" (UID: \"ad5ec099-8b13-4413-b074-00439e105408\") " pod="opendatahub/opendatahub-operator-controller-manager-fc7cc8c86-r48dl" Jul 23 22:27:09.888697 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:09.888674 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ad5ec099-8b13-4413-b074-00439e105408-manifests\") pod \"opendatahub-operator-controller-manager-fc7cc8c86-r48dl\" (UID: \"ad5ec099-8b13-4413-b074-00439e105408\") " pod="opendatahub/opendatahub-operator-controller-manager-fc7cc8c86-r48dl" Jul 23 22:27:09.888783 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:09.888712 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qmtr\" (UniqueName: \"kubernetes.io/projected/ad5ec099-8b13-4413-b074-00439e105408-kube-api-access-9qmtr\") pod \"opendatahub-operator-controller-manager-fc7cc8c86-r48dl\" (UID: \"ad5ec099-8b13-4413-b074-00439e105408\") " pod="opendatahub/opendatahub-operator-controller-manager-fc7cc8c86-r48dl" Jul 23 22:27:09.888783 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:09.888741 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ad5ec099-8b13-4413-b074-00439e105408-tmp\") pod \"opendatahub-operator-controller-manager-fc7cc8c86-r48dl\" (UID: \"ad5ec099-8b13-4413-b074-00439e105408\") " pod="opendatahub/opendatahub-operator-controller-manager-fc7cc8c86-r48dl" Jul 23 22:27:09.888783 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:09.888758 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ad5ec099-8b13-4413-b074-00439e105408-apiservice-cert\") pod \"opendatahub-operator-controller-manager-fc7cc8c86-r48dl\" (UID: \"ad5ec099-8b13-4413-b074-00439e105408\") " pod="opendatahub/opendatahub-operator-controller-manager-fc7cc8c86-r48dl" Jul 23 22:27:09.888935 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:09.888787 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ad5ec099-8b13-4413-b074-00439e105408-webhook-cert\") pod \"opendatahub-operator-controller-manager-fc7cc8c86-r48dl\" (UID: \"ad5ec099-8b13-4413-b074-00439e105408\") " pod="opendatahub/opendatahub-operator-controller-manager-fc7cc8c86-r48dl" Jul 23 22:27:09.889068 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:09.889048 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ad5ec099-8b13-4413-b074-00439e105408-manifests\") pod \"opendatahub-operator-controller-manager-fc7cc8c86-r48dl\" (UID: \"ad5ec099-8b13-4413-b074-00439e105408\") " pod="opendatahub/opendatahub-operator-controller-manager-fc7cc8c86-r48dl" Jul 23 22:27:09.891038 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:09.890997 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ad5ec099-8b13-4413-b074-00439e105408-tmp\") pod \"opendatahub-operator-controller-manager-fc7cc8c86-r48dl\" (UID: \"ad5ec099-8b13-4413-b074-00439e105408\") " pod="opendatahub/opendatahub-operator-controller-manager-fc7cc8c86-r48dl" Jul 23 22:27:09.891115 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:09.891075 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ad5ec099-8b13-4413-b074-00439e105408-apiservice-cert\") pod \"opendatahub-operator-controller-manager-fc7cc8c86-r48dl\" (UID: \"ad5ec099-8b13-4413-b074-00439e105408\") " pod="opendatahub/opendatahub-operator-controller-manager-fc7cc8c86-r48dl" Jul 23 22:27:09.891153 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:09.891142 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ad5ec099-8b13-4413-b074-00439e105408-webhook-cert\") pod \"opendatahub-operator-controller-manager-fc7cc8c86-r48dl\" (UID: \"ad5ec099-8b13-4413-b074-00439e105408\") " pod="opendatahub/opendatahub-operator-controller-manager-fc7cc8c86-r48dl" Jul 23 22:27:09.898688 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:09.898667 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qmtr\" (UniqueName: \"kubernetes.io/projected/ad5ec099-8b13-4413-b074-00439e105408-kube-api-access-9qmtr\") pod \"opendatahub-operator-controller-manager-fc7cc8c86-r48dl\" (UID: \"ad5ec099-8b13-4413-b074-00439e105408\") " pod="opendatahub/opendatahub-operator-controller-manager-fc7cc8c86-r48dl" Jul 23 22:27:09.918735 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:09.918709 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:27:09.987653 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:09.987632 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-fc7cc8c86-r48dl" Jul 23 22:27:10.009241 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:10.009209 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:27:10.107843 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:10.107815 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:27:10.118896 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:10.118876 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-fc7cc8c86-r48dl"] Jul 23 22:27:10.121003 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:27:10.120984 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad5ec099_8b13_4413_b074_00439e105408.slice/crio-b0152e11b77c3f3c1822cffc353d1e6f10d2a4f18b840481c5d4ecc6c81c1268 WatchSource:0}: Error finding container b0152e11b77c3f3c1822cffc353d1e6f10d2a4f18b840481c5d4ecc6c81c1268: Status 404 returned error can't find the container with id b0152e11b77c3f3c1822cffc353d1e6f10d2a4f18b840481c5d4ecc6c81c1268 Jul 23 22:27:10.209583 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:10.209564 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:27:10.308555 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:10.308533 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:27:10.415787 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:10.415744 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:27:10.946663 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:10.946623 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-fc7cc8c86-r48dl" event={"ID":"ad5ec099-8b13-4413-b074-00439e105408","Type":"ContainerStarted","Data":"b0152e11b77c3f3c1822cffc353d1e6f10d2a4f18b840481c5d4ecc6c81c1268"} Jul 23 22:27:13.962368 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:13.962330 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-fc7cc8c86-r48dl" event={"ID":"ad5ec099-8b13-4413-b074-00439e105408","Type":"ContainerStarted","Data":"d69720c31e15acc157c88d29b8176b31901be9f340a8ad3ba6fc8ca86f93ba76"} Jul 23 22:27:14.967760 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:14.967730 2575 generic.go:356] "Generic (PLEG): container finished" podID="ad5ec099-8b13-4413-b074-00439e105408" containerID="d69720c31e15acc157c88d29b8176b31901be9f340a8ad3ba6fc8ca86f93ba76" exitCode=0 Jul 23 22:27:14.968156 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:14.967815 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-fc7cc8c86-r48dl" event={"ID":"ad5ec099-8b13-4413-b074-00439e105408","Type":"ContainerDied","Data":"d69720c31e15acc157c88d29b8176b31901be9f340a8ad3ba6fc8ca86f93ba76"} Jul 23 22:27:15.973447 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:15.973418 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-fc7cc8c86-r48dl" event={"ID":"ad5ec099-8b13-4413-b074-00439e105408","Type":"ContainerStarted","Data":"3cb228f77848e239148cff0bf07aea7f151a37e24154a8df06d2d8f3bbdee355"} Jul 23 22:27:15.973769 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:15.973524 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-fc7cc8c86-r48dl" Jul 23 22:27:15.998029 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:15.997983 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-fc7cc8c86-r48dl" podStartSLOduration=2.437088795 podStartE2EDuration="6.997969897s" totalImagesPullingTime="3.637943492s" totalInitContainerRuntime="922.93761ms" isStatefulPod=false podCreationTimestamp="2026-07-23 22:27:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:27:15.996383742 +0000 UTC m=+263.716381022" watchObservedRunningTime="2026-07-23 22:27:15.997969897 +0000 UTC m=+263.717967181" Jul 23 22:27:17.517436 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:17.517382 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:27:17.619503 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:17.619477 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:27:26.979509 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:26.979482 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-fc7cc8c86-r48dl" Jul 23 22:27:28.938682 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:28.938651 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:27:29.045617 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:29.045594 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:27:29.609130 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:29.609099 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-699c848bdc-7pwp6"] Jul 23 22:27:29.616985 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:29.616957 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-699c848bdc-7pwp6" Jul 23 22:27:29.619217 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:29.619196 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 23 22:27:29.619399 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:29.619387 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-m5n9l\"" Jul 23 22:27:29.619457 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:29.619439 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 23 22:27:29.619499 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:29.619439 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 23 22:27:29.621634 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:29.621551 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 23 22:27:29.623169 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:29.623148 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-699c848bdc-7pwp6"] Jul 23 22:27:29.725263 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:29.725236 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnbkz\" (UniqueName: \"kubernetes.io/projected/8742c97d-f8fe-4030-8480-6c862102b94a-kube-api-access-wnbkz\") pod \"kube-auth-proxy-699c848bdc-7pwp6\" (UID: \"8742c97d-f8fe-4030-8480-6c862102b94a\") " pod="openshift-ingress/kube-auth-proxy-699c848bdc-7pwp6" Jul 23 22:27:29.725362 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:29.725283 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8742c97d-f8fe-4030-8480-6c862102b94a-tmp\") pod \"kube-auth-proxy-699c848bdc-7pwp6\" (UID: \"8742c97d-f8fe-4030-8480-6c862102b94a\") " pod="openshift-ingress/kube-auth-proxy-699c848bdc-7pwp6" Jul 23 22:27:29.725362 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:29.725343 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8742c97d-f8fe-4030-8480-6c862102b94a-tls-certs\") pod \"kube-auth-proxy-699c848bdc-7pwp6\" (UID: \"8742c97d-f8fe-4030-8480-6c862102b94a\") " pod="openshift-ingress/kube-auth-proxy-699c848bdc-7pwp6" Jul 23 22:27:29.740288 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:29.740262 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-85w2g"] Jul 23 22:27:29.743318 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:29.743302 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-85w2g" Jul 23 22:27:29.746573 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:29.746556 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 23 22:27:29.746647 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:29.746557 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-l65t8\"" Jul 23 22:27:29.764898 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:29.764868 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-85w2g"] Jul 23 22:27:29.826354 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:29.826331 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/771e5646-1a90-45c5-986f-e4fe256ea09b-cert\") pod \"odh-model-controller-7998c67dc4-85w2g\" (UID: \"771e5646-1a90-45c5-986f-e4fe256ea09b\") " pod="opendatahub/odh-model-controller-7998c67dc4-85w2g" Jul 23 22:27:29.826445 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:29.826371 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8742c97d-f8fe-4030-8480-6c862102b94a-tmp\") pod \"kube-auth-proxy-699c848bdc-7pwp6\" (UID: \"8742c97d-f8fe-4030-8480-6c862102b94a\") " pod="openshift-ingress/kube-auth-proxy-699c848bdc-7pwp6" Jul 23 22:27:29.826445 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:29.826391 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74phh\" (UniqueName: \"kubernetes.io/projected/771e5646-1a90-45c5-986f-e4fe256ea09b-kube-api-access-74phh\") pod \"odh-model-controller-7998c67dc4-85w2g\" (UID: \"771e5646-1a90-45c5-986f-e4fe256ea09b\") " pod="opendatahub/odh-model-controller-7998c67dc4-85w2g" Jul 23 22:27:29.826511 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:29.826459 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8742c97d-f8fe-4030-8480-6c862102b94a-tls-certs\") pod \"kube-auth-proxy-699c848bdc-7pwp6\" (UID: \"8742c97d-f8fe-4030-8480-6c862102b94a\") " pod="openshift-ingress/kube-auth-proxy-699c848bdc-7pwp6" Jul 23 22:27:29.826543 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:29.826513 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnbkz\" (UniqueName: \"kubernetes.io/projected/8742c97d-f8fe-4030-8480-6c862102b94a-kube-api-access-wnbkz\") pod \"kube-auth-proxy-699c848bdc-7pwp6\" (UID: \"8742c97d-f8fe-4030-8480-6c862102b94a\") " pod="openshift-ingress/kube-auth-proxy-699c848bdc-7pwp6" Jul 23 22:27:29.826577 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:27:29.826541 2575 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jul 23 22:27:29.826609 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:27:29.826596 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8742c97d-f8fe-4030-8480-6c862102b94a-tls-certs podName:8742c97d-f8fe-4030-8480-6c862102b94a nodeName:}" failed. No retries permitted until 2026-07-23 22:27:30.326577092 +0000 UTC m=+278.046574329 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/8742c97d-f8fe-4030-8480-6c862102b94a-tls-certs") pod "kube-auth-proxy-699c848bdc-7pwp6" (UID: "8742c97d-f8fe-4030-8480-6c862102b94a") : secret "kube-auth-proxy-tls" not found Jul 23 22:27:29.828460 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:29.828435 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8742c97d-f8fe-4030-8480-6c862102b94a-tmp\") pod \"kube-auth-proxy-699c848bdc-7pwp6\" (UID: \"8742c97d-f8fe-4030-8480-6c862102b94a\") " pod="openshift-ingress/kube-auth-proxy-699c848bdc-7pwp6" Jul 23 22:27:29.837355 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:29.837333 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnbkz\" (UniqueName: \"kubernetes.io/projected/8742c97d-f8fe-4030-8480-6c862102b94a-kube-api-access-wnbkz\") pod \"kube-auth-proxy-699c848bdc-7pwp6\" (UID: \"8742c97d-f8fe-4030-8480-6c862102b94a\") " pod="openshift-ingress/kube-auth-proxy-699c848bdc-7pwp6" Jul 23 22:27:29.926958 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:29.926933 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/771e5646-1a90-45c5-986f-e4fe256ea09b-cert\") pod \"odh-model-controller-7998c67dc4-85w2g\" (UID: \"771e5646-1a90-45c5-986f-e4fe256ea09b\") " pod="opendatahub/odh-model-controller-7998c67dc4-85w2g" Jul 23 22:27:29.927079 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:29.926983 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74phh\" (UniqueName: \"kubernetes.io/projected/771e5646-1a90-45c5-986f-e4fe256ea09b-kube-api-access-74phh\") pod \"odh-model-controller-7998c67dc4-85w2g\" (UID: \"771e5646-1a90-45c5-986f-e4fe256ea09b\") " pod="opendatahub/odh-model-controller-7998c67dc4-85w2g" Jul 23 22:27:29.927150 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:27:29.927077 2575 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 23 22:27:29.927150 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:27:29.927125 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/771e5646-1a90-45c5-986f-e4fe256ea09b-cert podName:771e5646-1a90-45c5-986f-e4fe256ea09b nodeName:}" failed. No retries permitted until 2026-07-23 22:27:30.427112283 +0000 UTC m=+278.147109520 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/771e5646-1a90-45c5-986f-e4fe256ea09b-cert") pod "odh-model-controller-7998c67dc4-85w2g" (UID: "771e5646-1a90-45c5-986f-e4fe256ea09b") : secret "odh-model-controller-webhook-cert" not found Jul 23 22:27:29.937650 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:29.937625 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-74phh\" (UniqueName: \"kubernetes.io/projected/771e5646-1a90-45c5-986f-e4fe256ea09b-kube-api-access-74phh\") pod \"odh-model-controller-7998c67dc4-85w2g\" (UID: \"771e5646-1a90-45c5-986f-e4fe256ea09b\") " pod="opendatahub/odh-model-controller-7998c67dc4-85w2g" Jul 23 22:27:30.283464 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:30.283430 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:27:30.331124 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:30.331056 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8742c97d-f8fe-4030-8480-6c862102b94a-tls-certs\") pod \"kube-auth-proxy-699c848bdc-7pwp6\" (UID: \"8742c97d-f8fe-4030-8480-6c862102b94a\") " pod="openshift-ingress/kube-auth-proxy-699c848bdc-7pwp6" Jul 23 22:27:30.334035 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:30.333998 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8742c97d-f8fe-4030-8480-6c862102b94a-tls-certs\") pod \"kube-auth-proxy-699c848bdc-7pwp6\" (UID: \"8742c97d-f8fe-4030-8480-6c862102b94a\") " pod="openshift-ingress/kube-auth-proxy-699c848bdc-7pwp6" Jul 23 22:27:30.432321 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:30.432288 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/771e5646-1a90-45c5-986f-e4fe256ea09b-cert\") pod \"odh-model-controller-7998c67dc4-85w2g\" (UID: \"771e5646-1a90-45c5-986f-e4fe256ea09b\") " pod="opendatahub/odh-model-controller-7998c67dc4-85w2g" Jul 23 22:27:30.434549 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:30.434526 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/771e5646-1a90-45c5-986f-e4fe256ea09b-cert\") pod \"odh-model-controller-7998c67dc4-85w2g\" (UID: \"771e5646-1a90-45c5-986f-e4fe256ea09b\") " pod="opendatahub/odh-model-controller-7998c67dc4-85w2g" Jul 23 22:27:30.527125 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:30.527098 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-699c848bdc-7pwp6" Jul 23 22:27:30.652321 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:30.652292 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-85w2g" Jul 23 22:27:30.662834 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:30.662728 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-699c848bdc-7pwp6"] Jul 23 22:27:30.665847 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:27:30.665823 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8742c97d_f8fe_4030_8480_6c862102b94a.slice/crio-79ac95d3c203b3b5aaf7afb2a0e3dd70e05a75237e6b66a3188832cda85d8711 WatchSource:0}: Error finding container 79ac95d3c203b3b5aaf7afb2a0e3dd70e05a75237e6b66a3188832cda85d8711: Status 404 returned error can't find the container with id 79ac95d3c203b3b5aaf7afb2a0e3dd70e05a75237e6b66a3188832cda85d8711 Jul 23 22:27:30.736498 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:30.736472 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-stgpz"] Jul 23 22:27:30.742788 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:30.742766 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-stgpz" Jul 23 22:27:30.745067 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:30.745037 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 23 22:27:30.754508 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:30.754042 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-stgpz"] Jul 23 22:27:30.756581 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:30.756557 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:27:30.786164 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:30.786090 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-85w2g"] Jul 23 22:27:30.788089 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:27:30.788041 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod771e5646_1a90_45c5_986f_e4fe256ea09b.slice/crio-5487e0db666ea9e0c4aa5fc759ffbd3151a87ed55e5015e2676e91fa5a38e3e7 WatchSource:0}: Error finding container 5487e0db666ea9e0c4aa5fc759ffbd3151a87ed55e5015e2676e91fa5a38e3e7: Status 404 returned error can't find the container with id 5487e0db666ea9e0c4aa5fc759ffbd3151a87ed55e5015e2676e91fa5a38e3e7 Jul 23 22:27:30.836645 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:30.836618 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8kxk\" (UniqueName: \"kubernetes.io/projected/dd788c3f-16af-4435-93cb-bd4102990b97-kube-api-access-d8kxk\") pod \"model-serving-api-54d89bd5fc-stgpz\" (UID: \"dd788c3f-16af-4435-93cb-bd4102990b97\") " pod="opendatahub/model-serving-api-54d89bd5fc-stgpz" Jul 23 22:27:30.836738 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:30.836710 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd788c3f-16af-4435-93cb-bd4102990b97-tls-certs\") pod \"model-serving-api-54d89bd5fc-stgpz\" (UID: \"dd788c3f-16af-4435-93cb-bd4102990b97\") " pod="opendatahub/model-serving-api-54d89bd5fc-stgpz" Jul 23 22:27:30.943050 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:30.938271 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8kxk\" (UniqueName: \"kubernetes.io/projected/dd788c3f-16af-4435-93cb-bd4102990b97-kube-api-access-d8kxk\") pod \"model-serving-api-54d89bd5fc-stgpz\" (UID: \"dd788c3f-16af-4435-93cb-bd4102990b97\") " pod="opendatahub/model-serving-api-54d89bd5fc-stgpz" Jul 23 22:27:30.943050 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:30.938388 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd788c3f-16af-4435-93cb-bd4102990b97-tls-certs\") pod \"model-serving-api-54d89bd5fc-stgpz\" (UID: \"dd788c3f-16af-4435-93cb-bd4102990b97\") " pod="opendatahub/model-serving-api-54d89bd5fc-stgpz" Jul 23 22:27:30.943050 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:30.940984 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-5zw5h"] Jul 23 22:27:30.944014 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:30.943991 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd788c3f-16af-4435-93cb-bd4102990b97-tls-certs\") pod \"model-serving-api-54d89bd5fc-stgpz\" (UID: \"dd788c3f-16af-4435-93cb-bd4102990b97\") " pod="opendatahub/model-serving-api-54d89bd5fc-stgpz" Jul 23 22:27:30.944927 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:30.944905 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:27:30.949000 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:30.948978 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-5zw5h" Jul 23 22:27:30.950451 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:30.950431 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8kxk\" (UniqueName: \"kubernetes.io/projected/dd788c3f-16af-4435-93cb-bd4102990b97-kube-api-access-d8kxk\") pod \"model-serving-api-54d89bd5fc-stgpz\" (UID: \"dd788c3f-16af-4435-93cb-bd4102990b97\") " pod="opendatahub/model-serving-api-54d89bd5fc-stgpz" Jul 23 22:27:30.951876 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:30.951855 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 23 22:27:30.951942 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:30.951861 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 23 22:27:30.952049 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:30.952011 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 23 22:27:30.952095 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:30.952067 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 23 22:27:30.952335 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:30.952322 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-kz72d\"" Jul 23 22:27:30.958772 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:30.958751 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-5zw5h"] Jul 23 22:27:31.032466 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:31.032436 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:27:31.033141 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:31.033121 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-699c848bdc-7pwp6" event={"ID":"8742c97d-f8fe-4030-8480-6c862102b94a","Type":"ContainerStarted","Data":"79ac95d3c203b3b5aaf7afb2a0e3dd70e05a75237e6b66a3188832cda85d8711"} Jul 23 22:27:31.034195 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:31.034168 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-85w2g" event={"ID":"771e5646-1a90-45c5-986f-e4fe256ea09b","Type":"ContainerStarted","Data":"5487e0db666ea9e0c4aa5fc759ffbd3151a87ed55e5015e2676e91fa5a38e3e7"} Jul 23 22:27:31.039582 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:31.039538 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7458abc4-58b9-49e7-90e3-e825c5ec67b3-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-5zw5h\" (UID: \"7458abc4-58b9-49e7-90e3-e825c5ec67b3\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5zw5h" Jul 23 22:27:31.039582 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:31.039566 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64lw7\" (UniqueName: \"kubernetes.io/projected/7458abc4-58b9-49e7-90e3-e825c5ec67b3-kube-api-access-64lw7\") pod \"istiod-openshift-gateway-7574459656-5zw5h\" (UID: \"7458abc4-58b9-49e7-90e3-e825c5ec67b3\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5zw5h" Jul 23 22:27:31.039717 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:31.039586 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7458abc4-58b9-49e7-90e3-e825c5ec67b3-local-certs\") pod \"istiod-openshift-gateway-7574459656-5zw5h\" (UID: \"7458abc4-58b9-49e7-90e3-e825c5ec67b3\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5zw5h" Jul 23 22:27:31.039717 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:31.039658 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7458abc4-58b9-49e7-90e3-e825c5ec67b3-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-5zw5h\" (UID: \"7458abc4-58b9-49e7-90e3-e825c5ec67b3\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5zw5h" Jul 23 22:27:31.039717 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:31.039698 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7458abc4-58b9-49e7-90e3-e825c5ec67b3-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-5zw5h\" (UID: \"7458abc4-58b9-49e7-90e3-e825c5ec67b3\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5zw5h" Jul 23 22:27:31.039818 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:31.039796 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7458abc4-58b9-49e7-90e3-e825c5ec67b3-istio-token\") pod \"istiod-openshift-gateway-7574459656-5zw5h\" (UID: \"7458abc4-58b9-49e7-90e3-e825c5ec67b3\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5zw5h" Jul 23 22:27:31.039818 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:31.039815 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7458abc4-58b9-49e7-90e3-e825c5ec67b3-cacerts\") pod \"istiod-openshift-gateway-7574459656-5zw5h\" (UID: \"7458abc4-58b9-49e7-90e3-e825c5ec67b3\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5zw5h" Jul 23 22:27:31.056510 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:31.056484 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-stgpz" Jul 23 22:27:31.140824 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:31.140791 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7458abc4-58b9-49e7-90e3-e825c5ec67b3-cacerts\") pod \"istiod-openshift-gateway-7574459656-5zw5h\" (UID: \"7458abc4-58b9-49e7-90e3-e825c5ec67b3\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5zw5h" Jul 23 22:27:31.140958 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:31.140935 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7458abc4-58b9-49e7-90e3-e825c5ec67b3-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-5zw5h\" (UID: \"7458abc4-58b9-49e7-90e3-e825c5ec67b3\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5zw5h" Jul 23 22:27:31.141034 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:31.140976 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64lw7\" (UniqueName: \"kubernetes.io/projected/7458abc4-58b9-49e7-90e3-e825c5ec67b3-kube-api-access-64lw7\") pod \"istiod-openshift-gateway-7574459656-5zw5h\" (UID: \"7458abc4-58b9-49e7-90e3-e825c5ec67b3\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5zw5h" Jul 23 22:27:31.141093 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:31.141014 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7458abc4-58b9-49e7-90e3-e825c5ec67b3-local-certs\") pod \"istiod-openshift-gateway-7574459656-5zw5h\" (UID: \"7458abc4-58b9-49e7-90e3-e825c5ec67b3\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5zw5h" Jul 23 22:27:31.141093 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:31.141086 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7458abc4-58b9-49e7-90e3-e825c5ec67b3-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-5zw5h\" (UID: \"7458abc4-58b9-49e7-90e3-e825c5ec67b3\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5zw5h" Jul 23 22:27:31.141197 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:31.141122 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7458abc4-58b9-49e7-90e3-e825c5ec67b3-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-5zw5h\" (UID: \"7458abc4-58b9-49e7-90e3-e825c5ec67b3\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5zw5h" Jul 23 22:27:31.141250 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:31.141218 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7458abc4-58b9-49e7-90e3-e825c5ec67b3-istio-token\") pod \"istiod-openshift-gateway-7574459656-5zw5h\" (UID: \"7458abc4-58b9-49e7-90e3-e825c5ec67b3\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5zw5h" Jul 23 22:27:31.141717 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:31.141689 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7458abc4-58b9-49e7-90e3-e825c5ec67b3-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-5zw5h\" (UID: \"7458abc4-58b9-49e7-90e3-e825c5ec67b3\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5zw5h" Jul 23 22:27:31.143206 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:31.143178 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7458abc4-58b9-49e7-90e3-e825c5ec67b3-cacerts\") pod \"istiod-openshift-gateway-7574459656-5zw5h\" (UID: \"7458abc4-58b9-49e7-90e3-e825c5ec67b3\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5zw5h" Jul 23 22:27:31.143567 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:31.143541 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7458abc4-58b9-49e7-90e3-e825c5ec67b3-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-5zw5h\" (UID: \"7458abc4-58b9-49e7-90e3-e825c5ec67b3\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5zw5h" Jul 23 22:27:31.143667 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:31.143652 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7458abc4-58b9-49e7-90e3-e825c5ec67b3-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-5zw5h\" (UID: \"7458abc4-58b9-49e7-90e3-e825c5ec67b3\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5zw5h" Jul 23 22:27:31.143709 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:31.143669 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7458abc4-58b9-49e7-90e3-e825c5ec67b3-local-certs\") pod \"istiod-openshift-gateway-7574459656-5zw5h\" (UID: \"7458abc4-58b9-49e7-90e3-e825c5ec67b3\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5zw5h" Jul 23 22:27:31.149891 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:31.149870 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-64lw7\" (UniqueName: \"kubernetes.io/projected/7458abc4-58b9-49e7-90e3-e825c5ec67b3-kube-api-access-64lw7\") pod \"istiod-openshift-gateway-7574459656-5zw5h\" (UID: \"7458abc4-58b9-49e7-90e3-e825c5ec67b3\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5zw5h" Jul 23 22:27:31.150498 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:31.150480 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7458abc4-58b9-49e7-90e3-e825c5ec67b3-istio-token\") pod \"istiod-openshift-gateway-7574459656-5zw5h\" (UID: \"7458abc4-58b9-49e7-90e3-e825c5ec67b3\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5zw5h" Jul 23 22:27:31.180332 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:31.180283 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-stgpz"] Jul 23 22:27:31.182265 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:27:31.182232 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd788c3f_16af_4435_93cb_bd4102990b97.slice/crio-356e01624e44ab619afbbea791e35af2a287f3ddebd1a6dd4fe238e98623a64a WatchSource:0}: Error finding container 356e01624e44ab619afbbea791e35af2a287f3ddebd1a6dd4fe238e98623a64a: Status 404 returned error can't find the container with id 356e01624e44ab619afbbea791e35af2a287f3ddebd1a6dd4fe238e98623a64a Jul 23 22:27:31.265057 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:31.265039 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-5zw5h" Jul 23 22:27:31.429847 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:31.429783 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-5zw5h"] Jul 23 22:27:31.434770 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:27:31.434741 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7458abc4_58b9_49e7_90e3_e825c5ec67b3.slice/crio-c55c36d42b0466277f8e99ca4abcffcefa2ade7a0392d5f8f6ecd03db0c7bbe6 WatchSource:0}: Error finding container c55c36d42b0466277f8e99ca4abcffcefa2ade7a0392d5f8f6ecd03db0c7bbe6: Status 404 returned error can't find the container with id c55c36d42b0466277f8e99ca4abcffcefa2ade7a0392d5f8f6ecd03db0c7bbe6 Jul 23 22:27:32.041354 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:32.041309 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-stgpz" event={"ID":"dd788c3f-16af-4435-93cb-bd4102990b97","Type":"ContainerStarted","Data":"356e01624e44ab619afbbea791e35af2a287f3ddebd1a6dd4fe238e98623a64a"} Jul 23 22:27:32.042844 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:32.042815 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-5zw5h" event={"ID":"7458abc4-58b9-49e7-90e3-e825c5ec67b3","Type":"ContainerStarted","Data":"c55c36d42b0466277f8e99ca4abcffcefa2ade7a0392d5f8f6ecd03db0c7bbe6"} Jul 23 22:27:32.189637 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:32.189570 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:27:35.593989 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:35.593937 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 23 22:27:35.594433 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:35.594052 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 23 22:27:36.066385 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:36.066346 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-stgpz" event={"ID":"dd788c3f-16af-4435-93cb-bd4102990b97","Type":"ContainerStarted","Data":"7f9fc7139ccf6f6c35f02879c004ca51edf76217b12505794ef2ced10e49a861"} Jul 23 22:27:36.066569 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:36.066414 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-stgpz" Jul 23 22:27:36.068105 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:36.068076 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-5zw5h" event={"ID":"7458abc4-58b9-49e7-90e3-e825c5ec67b3","Type":"ContainerStarted","Data":"a8534456dcb6ae7b245a7a403bc85404185330a80a8f77c66fa0e3eecabef506"} Jul 23 22:27:36.068262 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:36.068233 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-5zw5h" Jul 23 22:27:36.070038 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:36.069951 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-699c848bdc-7pwp6" event={"ID":"8742c97d-f8fe-4030-8480-6c862102b94a","Type":"ContainerStarted","Data":"b1f9961a3c35215a08abe7579c414d40f78fb91f7fe43a583c3398ce6555dfe4"} Jul 23 22:27:36.070169 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:36.070054 2575 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-5zw5h container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 23 22:27:36.070169 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:36.070101 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-5zw5h" podUID="7458abc4-58b9-49e7-90e3-e825c5ec67b3" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 23 22:27:36.071621 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:36.071593 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-85w2g" event={"ID":"771e5646-1a90-45c5-986f-e4fe256ea09b","Type":"ContainerStarted","Data":"88fbc97b81b661d5ab767b7511da3442188bdb4d7e64eec9ca81f27e7952a2f4"} Jul 23 22:27:36.071727 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:36.071652 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-85w2g" Jul 23 22:27:36.106967 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:36.106925 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-stgpz" podStartSLOduration=1.763852086 podStartE2EDuration="6.106912781s" totalImagesPullingTime="4.343060695s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 22:27:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:27:36.106624656 +0000 UTC m=+283.826621916" watchObservedRunningTime="2026-07-23 22:27:36.106912781 +0000 UTC m=+283.826910031" Jul 23 22:27:36.138363 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:36.138322 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-699c848bdc-7pwp6" podStartSLOduration=2.278213993 podStartE2EDuration="7.138310245s" totalImagesPullingTime="4.860096252s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 22:27:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:27:36.137998997 +0000 UTC m=+283.857996290" watchObservedRunningTime="2026-07-23 22:27:36.138310245 +0000 UTC m=+283.858307503" Jul 23 22:27:36.160639 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:36.160602 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-5zw5h" podStartSLOduration=2.005430141 podStartE2EDuration="6.160588701s" totalImagesPullingTime="4.15515856s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 22:27:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:27:36.158981483 +0000 UTC m=+283.878978742" watchObservedRunningTime="2026-07-23 22:27:36.160588701 +0000 UTC m=+283.880585960" Jul 23 22:27:36.180686 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:36.180643 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-85w2g" podStartSLOduration=2.442416684 podStartE2EDuration="7.180631087s" totalImagesPullingTime="4.738214403s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 22:27:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:27:36.179329543 +0000 UTC m=+283.899326836" watchObservedRunningTime="2026-07-23 22:27:36.180631087 +0000 UTC m=+283.900628413" Jul 23 22:27:36.706552 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:36.706513 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:27:36.806159 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:36.806129 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:27:37.076979 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:37.076909 2575 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-5zw5h container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 23 22:27:37.076979 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:37.076957 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-5zw5h" podUID="7458abc4-58b9-49e7-90e3-e825c5ec67b3" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 23 22:27:37.635853 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:37.635821 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:27:38.015220 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:38.015191 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:27:38.361410 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:38.361322 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:27:40.077109 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:40.077081 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-5zw5h" Jul 23 22:27:40.550460 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:40.550428 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:27:40.648296 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:40.648265 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-82dhr"] Jul 23 22:27:40.651431 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:40.651416 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-82dhr" Jul 23 22:27:40.654491 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:40.654454 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-nq9wb\"" Jul 23 22:27:40.654713 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:40.654691 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 23 22:27:40.656898 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:40.656873 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:27:40.664943 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:40.664924 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-82dhr"] Jul 23 22:27:40.668702 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:40.668683 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-wdg95"] Jul 23 22:27:40.672112 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:40.672094 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wdg95" Jul 23 22:27:40.674433 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:40.674416 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 23 22:27:40.674535 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:40.674489 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-ss5xj\"" Jul 23 22:27:40.691111 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:40.691091 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-wdg95"] Jul 23 22:27:40.821804 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:40.821745 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54s7j\" (UniqueName: \"kubernetes.io/projected/c5d218fa-2c98-4d18-acf7-634f4a14ca6c-kube-api-access-54s7j\") pod \"kserve-controller-manager-d6f4b65b8-82dhr\" (UID: \"c5d218fa-2c98-4d18-acf7-634f4a14ca6c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-82dhr" Jul 23 22:27:40.821888 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:40.821806 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c33f2b09-f61a-4d5e-a53e-6b1cfddb0ab7-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-wdg95\" (UID: \"c33f2b09-f61a-4d5e-a53e-6b1cfddb0ab7\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wdg95" Jul 23 22:27:40.821888 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:40.821841 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74m84\" (UniqueName: \"kubernetes.io/projected/c33f2b09-f61a-4d5e-a53e-6b1cfddb0ab7-kube-api-access-74m84\") pod \"llmisvc-controller-manager-777c6bd7d5-wdg95\" (UID: \"c33f2b09-f61a-4d5e-a53e-6b1cfddb0ab7\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wdg95" Jul 23 22:27:40.821888 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:40.821872 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c5d218fa-2c98-4d18-acf7-634f4a14ca6c-cert\") pod \"kserve-controller-manager-d6f4b65b8-82dhr\" (UID: \"c5d218fa-2c98-4d18-acf7-634f4a14ca6c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-82dhr" Jul 23 22:27:40.922208 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:40.922180 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c33f2b09-f61a-4d5e-a53e-6b1cfddb0ab7-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-wdg95\" (UID: \"c33f2b09-f61a-4d5e-a53e-6b1cfddb0ab7\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wdg95" Jul 23 22:27:40.922326 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:40.922215 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74m84\" (UniqueName: \"kubernetes.io/projected/c33f2b09-f61a-4d5e-a53e-6b1cfddb0ab7-kube-api-access-74m84\") pod \"llmisvc-controller-manager-777c6bd7d5-wdg95\" (UID: \"c33f2b09-f61a-4d5e-a53e-6b1cfddb0ab7\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wdg95" Jul 23 22:27:40.922326 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:40.922236 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c5d218fa-2c98-4d18-acf7-634f4a14ca6c-cert\") pod \"kserve-controller-manager-d6f4b65b8-82dhr\" (UID: \"c5d218fa-2c98-4d18-acf7-634f4a14ca6c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-82dhr" Jul 23 22:27:40.922326 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:40.922278 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54s7j\" (UniqueName: \"kubernetes.io/projected/c5d218fa-2c98-4d18-acf7-634f4a14ca6c-kube-api-access-54s7j\") pod \"kserve-controller-manager-d6f4b65b8-82dhr\" (UID: \"c5d218fa-2c98-4d18-acf7-634f4a14ca6c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-82dhr" Jul 23 22:27:40.924722 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:40.924699 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c33f2b09-f61a-4d5e-a53e-6b1cfddb0ab7-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-wdg95\" (UID: \"c33f2b09-f61a-4d5e-a53e-6b1cfddb0ab7\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wdg95" Jul 23 22:27:40.924813 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:40.924699 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c5d218fa-2c98-4d18-acf7-634f4a14ca6c-cert\") pod \"kserve-controller-manager-d6f4b65b8-82dhr\" (UID: \"c5d218fa-2c98-4d18-acf7-634f4a14ca6c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-82dhr" Jul 23 22:27:40.938204 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:40.938182 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-74m84\" (UniqueName: \"kubernetes.io/projected/c33f2b09-f61a-4d5e-a53e-6b1cfddb0ab7-kube-api-access-74m84\") pod \"llmisvc-controller-manager-777c6bd7d5-wdg95\" (UID: \"c33f2b09-f61a-4d5e-a53e-6b1cfddb0ab7\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wdg95" Jul 23 22:27:40.939539 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:40.939521 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-54s7j\" (UniqueName: \"kubernetes.io/projected/c5d218fa-2c98-4d18-acf7-634f4a14ca6c-kube-api-access-54s7j\") pod \"kserve-controller-manager-d6f4b65b8-82dhr\" (UID: \"c5d218fa-2c98-4d18-acf7-634f4a14ca6c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-82dhr" Jul 23 22:27:40.961571 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:40.961361 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-82dhr" Jul 23 22:27:40.962225 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:40.962198 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:27:40.981142 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:40.981119 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wdg95" Jul 23 22:27:41.070719 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:41.070684 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:27:41.118418 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:41.118391 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-82dhr"] Jul 23 22:27:41.121461 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:27:41.121440 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5d218fa_2c98_4d18_acf7_634f4a14ca6c.slice/crio-5755c445e9443dcc1a9e2839fe189c1524f7350471ccda009c49dc846a092a1e WatchSource:0}: Error finding container 5755c445e9443dcc1a9e2839fe189c1524f7350471ccda009c49dc846a092a1e: Status 404 returned error can't find the container with id 5755c445e9443dcc1a9e2839fe189c1524f7350471ccda009c49dc846a092a1e Jul 23 22:27:41.158322 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:41.158304 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-wdg95"] Jul 23 22:27:41.159968 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:27:41.159945 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc33f2b09_f61a_4d5e_a53e_6b1cfddb0ab7.slice/crio-48cd33b9ca67a76828ff228d3595fea1c2d69958319389f889c153ad11ff3e4f WatchSource:0}: Error finding container 48cd33b9ca67a76828ff228d3595fea1c2d69958319389f889c153ad11ff3e4f: Status 404 returned error can't find the container with id 48cd33b9ca67a76828ff228d3595fea1c2d69958319389f889c153ad11ff3e4f Jul 23 22:27:41.796550 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:41.796523 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-5zw5h"] Jul 23 22:27:41.796696 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:41.796678 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-5zw5h" podUID="7458abc4-58b9-49e7-90e3-e825c5ec67b3" containerName="discovery" containerID="cri-o://a8534456dcb6ae7b245a7a403bc85404185330a80a8f77c66fa0e3eecabef506" gracePeriod=30 Jul 23 22:27:41.937272 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:41.936847 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:27:42.042326 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:42.042277 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:27:42.095253 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:42.095229 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-5zw5h" Jul 23 22:27:42.100450 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:42.100426 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-82dhr" event={"ID":"c5d218fa-2c98-4d18-acf7-634f4a14ca6c","Type":"ContainerStarted","Data":"5755c445e9443dcc1a9e2839fe189c1524f7350471ccda009c49dc846a092a1e"} Jul 23 22:27:42.101749 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:42.101704 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wdg95" event={"ID":"c33f2b09-f61a-4d5e-a53e-6b1cfddb0ab7","Type":"ContainerStarted","Data":"48cd33b9ca67a76828ff228d3595fea1c2d69958319389f889c153ad11ff3e4f"} Jul 23 22:27:42.103085 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:42.103061 2575 generic.go:356] "Generic (PLEG): container finished" podID="7458abc4-58b9-49e7-90e3-e825c5ec67b3" containerID="a8534456dcb6ae7b245a7a403bc85404185330a80a8f77c66fa0e3eecabef506" exitCode=0 Jul 23 22:27:42.103188 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:42.103094 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-5zw5h" Jul 23 22:27:42.103188 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:42.103124 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-5zw5h" event={"ID":"7458abc4-58b9-49e7-90e3-e825c5ec67b3","Type":"ContainerDied","Data":"a8534456dcb6ae7b245a7a403bc85404185330a80a8f77c66fa0e3eecabef506"} Jul 23 22:27:42.103188 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:42.103167 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-5zw5h" event={"ID":"7458abc4-58b9-49e7-90e3-e825c5ec67b3","Type":"ContainerDied","Data":"c55c36d42b0466277f8e99ca4abcffcefa2ade7a0392d5f8f6ecd03db0c7bbe6"} Jul 23 22:27:42.103335 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:42.103193 2575 scope.go:117] "RemoveContainer" containerID="a8534456dcb6ae7b245a7a403bc85404185330a80a8f77c66fa0e3eecabef506" Jul 23 22:27:42.131130 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:42.131005 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:27:42.166366 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:42.166337 2575 scope.go:117] "RemoveContainer" containerID="a8534456dcb6ae7b245a7a403bc85404185330a80a8f77c66fa0e3eecabef506" Jul 23 22:27:42.166679 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:27:42.166655 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8534456dcb6ae7b245a7a403bc85404185330a80a8f77c66fa0e3eecabef506\": container with ID starting with a8534456dcb6ae7b245a7a403bc85404185330a80a8f77c66fa0e3eecabef506 not found: ID does not exist" containerID="a8534456dcb6ae7b245a7a403bc85404185330a80a8f77c66fa0e3eecabef506" Jul 23 22:27:42.166784 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:42.166686 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8534456dcb6ae7b245a7a403bc85404185330a80a8f77c66fa0e3eecabef506"} err="failed to get container status \"a8534456dcb6ae7b245a7a403bc85404185330a80a8f77c66fa0e3eecabef506\": rpc error: code = NotFound desc = could not find container \"a8534456dcb6ae7b245a7a403bc85404185330a80a8f77c66fa0e3eecabef506\": container with ID starting with a8534456dcb6ae7b245a7a403bc85404185330a80a8f77c66fa0e3eecabef506 not found: ID does not exist" Jul 23 22:27:42.231103 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:42.230406 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-64lw7\" (UniqueName: \"kubernetes.io/projected/7458abc4-58b9-49e7-90e3-e825c5ec67b3-kube-api-access-64lw7\") pod \"7458abc4-58b9-49e7-90e3-e825c5ec67b3\" (UID: \"7458abc4-58b9-49e7-90e3-e825c5ec67b3\") " Jul 23 22:27:42.231103 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:42.230445 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7458abc4-58b9-49e7-90e3-e825c5ec67b3-istio-token\") pod \"7458abc4-58b9-49e7-90e3-e825c5ec67b3\" (UID: \"7458abc4-58b9-49e7-90e3-e825c5ec67b3\") " Jul 23 22:27:42.231103 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:42.230500 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7458abc4-58b9-49e7-90e3-e825c5ec67b3-istio-csr-dns-cert\") pod \"7458abc4-58b9-49e7-90e3-e825c5ec67b3\" (UID: \"7458abc4-58b9-49e7-90e3-e825c5ec67b3\") " Jul 23 22:27:42.231103 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:42.230536 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7458abc4-58b9-49e7-90e3-e825c5ec67b3-istio-kubeconfig\") pod \"7458abc4-58b9-49e7-90e3-e825c5ec67b3\" (UID: \"7458abc4-58b9-49e7-90e3-e825c5ec67b3\") " Jul 23 22:27:42.231103 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:42.230568 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7458abc4-58b9-49e7-90e3-e825c5ec67b3-local-certs\") pod \"7458abc4-58b9-49e7-90e3-e825c5ec67b3\" (UID: \"7458abc4-58b9-49e7-90e3-e825c5ec67b3\") " Jul 23 22:27:42.231103 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:42.230631 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7458abc4-58b9-49e7-90e3-e825c5ec67b3-cacerts\") pod \"7458abc4-58b9-49e7-90e3-e825c5ec67b3\" (UID: \"7458abc4-58b9-49e7-90e3-e825c5ec67b3\") " Jul 23 22:27:42.231103 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:42.230689 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7458abc4-58b9-49e7-90e3-e825c5ec67b3-istio-csr-ca-configmap\") pod \"7458abc4-58b9-49e7-90e3-e825c5ec67b3\" (UID: \"7458abc4-58b9-49e7-90e3-e825c5ec67b3\") " Jul 23 22:27:42.232202 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:42.231938 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7458abc4-58b9-49e7-90e3-e825c5ec67b3-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "7458abc4-58b9-49e7-90e3-e825c5ec67b3" (UID: "7458abc4-58b9-49e7-90e3-e825c5ec67b3"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 22:27:42.238217 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:42.238175 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7458abc4-58b9-49e7-90e3-e825c5ec67b3-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "7458abc4-58b9-49e7-90e3-e825c5ec67b3" (UID: "7458abc4-58b9-49e7-90e3-e825c5ec67b3"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 22:27:42.238217 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:42.238189 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7458abc4-58b9-49e7-90e3-e825c5ec67b3-local-certs" (OuterVolumeSpecName: "local-certs") pod "7458abc4-58b9-49e7-90e3-e825c5ec67b3" (UID: "7458abc4-58b9-49e7-90e3-e825c5ec67b3"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 22:27:42.238363 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:42.238242 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7458abc4-58b9-49e7-90e3-e825c5ec67b3-istio-token" (OuterVolumeSpecName: "istio-token") pod "7458abc4-58b9-49e7-90e3-e825c5ec67b3" (UID: "7458abc4-58b9-49e7-90e3-e825c5ec67b3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 22:27:42.238765 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:42.238613 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7458abc4-58b9-49e7-90e3-e825c5ec67b3-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "7458abc4-58b9-49e7-90e3-e825c5ec67b3" (UID: "7458abc4-58b9-49e7-90e3-e825c5ec67b3"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 22:27:42.238765 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:42.238738 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7458abc4-58b9-49e7-90e3-e825c5ec67b3-cacerts" (OuterVolumeSpecName: "cacerts") pod "7458abc4-58b9-49e7-90e3-e825c5ec67b3" (UID: "7458abc4-58b9-49e7-90e3-e825c5ec67b3"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 22:27:42.242563 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:42.242475 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7458abc4-58b9-49e7-90e3-e825c5ec67b3-kube-api-access-64lw7" (OuterVolumeSpecName: "kube-api-access-64lw7") pod "7458abc4-58b9-49e7-90e3-e825c5ec67b3" (UID: "7458abc4-58b9-49e7-90e3-e825c5ec67b3"). InnerVolumeSpecName "kube-api-access-64lw7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 22:27:42.331849 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:42.331768 2575 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7458abc4-58b9-49e7-90e3-e825c5ec67b3-istio-csr-dns-cert\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 22:27:42.331849 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:42.331804 2575 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7458abc4-58b9-49e7-90e3-e825c5ec67b3-istio-kubeconfig\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 22:27:42.331849 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:42.331821 2575 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7458abc4-58b9-49e7-90e3-e825c5ec67b3-local-certs\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 22:27:42.331849 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:42.331834 2575 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7458abc4-58b9-49e7-90e3-e825c5ec67b3-cacerts\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 22:27:42.331849 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:42.331846 2575 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7458abc4-58b9-49e7-90e3-e825c5ec67b3-istio-csr-ca-configmap\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 22:27:42.332274 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:42.331859 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-64lw7\" (UniqueName: \"kubernetes.io/projected/7458abc4-58b9-49e7-90e3-e825c5ec67b3-kube-api-access-64lw7\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 22:27:42.332274 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:42.331871 2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7458abc4-58b9-49e7-90e3-e825c5ec67b3-istio-token\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 22:27:42.438013 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:42.437942 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-5zw5h"] Jul 23 22:27:42.441158 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:42.441125 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-5zw5h"] Jul 23 22:27:42.808391 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:42.808358 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7458abc4-58b9-49e7-90e3-e825c5ec67b3" path="/var/lib/kubelet/pods/7458abc4-58b9-49e7-90e3-e825c5ec67b3/volumes" Jul 23 22:27:45.119504 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:45.119453 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-82dhr" event={"ID":"c5d218fa-2c98-4d18-acf7-634f4a14ca6c","Type":"ContainerStarted","Data":"b12416de4fb1c506e8351540bb6d8bbaf295ee2561e4e097c071638390c60230"} Jul 23 22:27:45.119890 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:45.119617 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-82dhr" Jul 23 22:27:45.120975 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:45.120947 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wdg95" event={"ID":"c33f2b09-f61a-4d5e-a53e-6b1cfddb0ab7","Type":"ContainerStarted","Data":"b9c639f802d9bed4f2b2f79edf2377ccfd6e15fa62c62cfc30181e4e63ca3ae5"} Jul 23 22:27:45.121082 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:45.121063 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wdg95" Jul 23 22:27:45.138357 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:45.138316 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-82dhr" podStartSLOduration=1.853908897 podStartE2EDuration="5.138303044s" totalImagesPullingTime="3.284394147s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 22:27:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:27:45.13749217 +0000 UTC m=+292.857489429" watchObservedRunningTime="2026-07-23 22:27:45.138303044 +0000 UTC m=+292.858300304" Jul 23 22:27:45.158105 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:45.158063 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wdg95" podStartSLOduration=1.90867158 podStartE2EDuration="5.158051665s" totalImagesPullingTime="3.249380085s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 22:27:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:27:45.156591567 +0000 UTC m=+292.876588849" watchObservedRunningTime="2026-07-23 22:27:45.158051665 +0000 UTC m=+292.878048922" Jul 23 22:27:47.079131 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:47.079103 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-85w2g" Jul 23 22:27:47.082190 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:47.082168 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-stgpz" Jul 23 22:27:52.692445 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:27:52.692424 2575 kubelet.go:1648] "Image garbage collection succeeded" Jul 23 22:28:16.129012 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:16.128982 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wdg95" Jul 23 22:28:16.131997 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:16.131974 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-82dhr" Jul 23 22:28:17.417670 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:17.417635 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:28:17.479437 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:17.479413 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:28:30.539062 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:30.539015 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:28:30.630668 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:30.630631 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:28:30.711921 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:30.711886 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dtbr6"] Jul 23 22:28:30.712308 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:30.712294 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7458abc4-58b9-49e7-90e3-e825c5ec67b3" containerName="discovery" Jul 23 22:28:30.712362 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:30.712309 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7458abc4-58b9-49e7-90e3-e825c5ec67b3" containerName="discovery" Jul 23 22:28:30.712409 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:30.712362 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="7458abc4-58b9-49e7-90e3-e825c5ec67b3" containerName="discovery" Jul 23 22:28:30.715439 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:30.715422 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dtbr6" Jul 23 22:28:30.720752 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:30.720728 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 23 22:28:30.720897 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:30.720753 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 23 22:28:30.721713 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:30.721693 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-2qj9q\"" Jul 23 22:28:30.732831 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:30.732802 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dtbr6"] Jul 23 22:28:30.777404 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:30.777374 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:28:30.810407 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:30.810335 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hv552\" (UniqueName: \"kubernetes.io/projected/523a4efa-1562-4a33-ba53-80795258764d-kube-api-access-hv552\") pod \"kuadrant-operator-catalog-dtbr6\" (UID: \"523a4efa-1562-4a33-ba53-80795258764d\") " pod="kuadrant-system/kuadrant-operator-catalog-dtbr6" Jul 23 22:28:30.911042 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:30.910988 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hv552\" (UniqueName: \"kubernetes.io/projected/523a4efa-1562-4a33-ba53-80795258764d-kube-api-access-hv552\") pod \"kuadrant-operator-catalog-dtbr6\" (UID: \"523a4efa-1562-4a33-ba53-80795258764d\") " pod="kuadrant-system/kuadrant-operator-catalog-dtbr6" Jul 23 22:28:30.921327 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:30.921296 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hv552\" (UniqueName: \"kubernetes.io/projected/523a4efa-1562-4a33-ba53-80795258764d-kube-api-access-hv552\") pod \"kuadrant-operator-catalog-dtbr6\" (UID: \"523a4efa-1562-4a33-ba53-80795258764d\") " pod="kuadrant-system/kuadrant-operator-catalog-dtbr6" Jul 23 22:28:31.025277 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:31.025243 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dtbr6" Jul 23 22:28:31.033924 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:31.033897 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dtbr6"] Jul 23 22:28:31.155986 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:31.155956 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dtbr6"] Jul 23 22:28:31.159302 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:28:31.159277 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod523a4efa_1562_4a33_ba53_80795258764d.slice/crio-015b1cd62ae777eae0e0b6a54cce579cdd899d5b7763c72dd8417b95b11830ea WatchSource:0}: Error finding container 015b1cd62ae777eae0e0b6a54cce579cdd899d5b7763c72dd8417b95b11830ea: Status 404 returned error can't find the container with id 015b1cd62ae777eae0e0b6a54cce579cdd899d5b7763c72dd8417b95b11830ea Jul 23 22:28:31.160615 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:31.160596 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 23 22:28:31.244717 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:31.244686 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kfxxn"] Jul 23 22:28:31.247583 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:31.247568 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-kfxxn" Jul 23 22:28:31.256796 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:31.256772 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kfxxn"] Jul 23 22:28:31.324490 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:31.324455 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dtbr6" event={"ID":"523a4efa-1562-4a33-ba53-80795258764d","Type":"ContainerStarted","Data":"015b1cd62ae777eae0e0b6a54cce579cdd899d5b7763c72dd8417b95b11830ea"} Jul 23 22:28:31.416140 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:31.416048 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gd2t\" (UniqueName: \"kubernetes.io/projected/2ec47862-f260-4973-909c-0ff17c9a3d88-kube-api-access-9gd2t\") pod \"kuadrant-operator-catalog-kfxxn\" (UID: \"2ec47862-f260-4973-909c-0ff17c9a3d88\") " pod="kuadrant-system/kuadrant-operator-catalog-kfxxn" Jul 23 22:28:31.517268 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:31.517240 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gd2t\" (UniqueName: \"kubernetes.io/projected/2ec47862-f260-4973-909c-0ff17c9a3d88-kube-api-access-9gd2t\") pod \"kuadrant-operator-catalog-kfxxn\" (UID: \"2ec47862-f260-4973-909c-0ff17c9a3d88\") " pod="kuadrant-system/kuadrant-operator-catalog-kfxxn" Jul 23 22:28:31.526289 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:31.526259 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gd2t\" (UniqueName: \"kubernetes.io/projected/2ec47862-f260-4973-909c-0ff17c9a3d88-kube-api-access-9gd2t\") pod \"kuadrant-operator-catalog-kfxxn\" (UID: \"2ec47862-f260-4973-909c-0ff17c9a3d88\") " pod="kuadrant-system/kuadrant-operator-catalog-kfxxn" Jul 23 22:28:31.557222 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:31.557194 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-kfxxn" Jul 23 22:28:31.691401 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:31.691367 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kfxxn"] Jul 23 22:28:31.713506 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:28:31.713477 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ec47862_f260_4973_909c_0ff17c9a3d88.slice/crio-0d908f475c8df28ea1d508b6380db66639b495350c5b3716a837bca4291ff914 WatchSource:0}: Error finding container 0d908f475c8df28ea1d508b6380db66639b495350c5b3716a837bca4291ff914: Status 404 returned error can't find the container with id 0d908f475c8df28ea1d508b6380db66639b495350c5b3716a837bca4291ff914 Jul 23 22:28:32.332438 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:32.332395 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-kfxxn" event={"ID":"2ec47862-f260-4973-909c-0ff17c9a3d88","Type":"ContainerStarted","Data":"0d908f475c8df28ea1d508b6380db66639b495350c5b3716a837bca4291ff914"} Jul 23 22:28:33.339222 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:33.339128 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-kfxxn" event={"ID":"2ec47862-f260-4973-909c-0ff17c9a3d88","Type":"ContainerStarted","Data":"6f689e90cb51d2f2df9df8e8118d0c36356b5a88db1e1689e9c7d9e7df89c62e"} Jul 23 22:28:33.340577 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:33.340555 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dtbr6" event={"ID":"523a4efa-1562-4a33-ba53-80795258764d","Type":"ContainerStarted","Data":"6467c72bd088f9fa4c901df61ef866e6b5668b188aac8b1056caa52441e4a5f4"} Jul 23 22:28:33.340676 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:33.340652 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-dtbr6" podUID="523a4efa-1562-4a33-ba53-80795258764d" containerName="registry-server" containerID="cri-o://6467c72bd088f9fa4c901df61ef866e6b5668b188aac8b1056caa52441e4a5f4" gracePeriod=2 Jul 23 22:28:33.355189 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:33.355142 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-kfxxn" podStartSLOduration=1.004344432 podStartE2EDuration="2.355125808s" totalImagesPullingTime="1.350781376s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 22:28:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:28:33.355008805 +0000 UTC m=+341.075006065" watchObservedRunningTime="2026-07-23 22:28:33.355125808 +0000 UTC m=+341.075123067" Jul 23 22:28:33.586973 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:33.586950 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dtbr6" Jul 23 22:28:33.738225 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:33.738192 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hv552\" (UniqueName: \"kubernetes.io/projected/523a4efa-1562-4a33-ba53-80795258764d-kube-api-access-hv552\") pod \"523a4efa-1562-4a33-ba53-80795258764d\" (UID: \"523a4efa-1562-4a33-ba53-80795258764d\") " Jul 23 22:28:33.740407 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:33.740383 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/523a4efa-1562-4a33-ba53-80795258764d-kube-api-access-hv552" (OuterVolumeSpecName: "kube-api-access-hv552") pod "523a4efa-1562-4a33-ba53-80795258764d" (UID: "523a4efa-1562-4a33-ba53-80795258764d"). InnerVolumeSpecName "kube-api-access-hv552". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 22:28:33.839112 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:33.839077 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hv552\" (UniqueName: \"kubernetes.io/projected/523a4efa-1562-4a33-ba53-80795258764d-kube-api-access-hv552\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 22:28:34.346065 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:34.345950 2575 generic.go:356] "Generic (PLEG): container finished" podID="523a4efa-1562-4a33-ba53-80795258764d" containerID="6467c72bd088f9fa4c901df61ef866e6b5668b188aac8b1056caa52441e4a5f4" exitCode=0 Jul 23 22:28:34.346065 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:34.345993 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dtbr6" Jul 23 22:28:34.346544 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:34.346055 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dtbr6" event={"ID":"523a4efa-1562-4a33-ba53-80795258764d","Type":"ContainerDied","Data":"6467c72bd088f9fa4c901df61ef866e6b5668b188aac8b1056caa52441e4a5f4"} Jul 23 22:28:34.346544 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:34.346107 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dtbr6" event={"ID":"523a4efa-1562-4a33-ba53-80795258764d","Type":"ContainerDied","Data":"015b1cd62ae777eae0e0b6a54cce579cdd899d5b7763c72dd8417b95b11830ea"} Jul 23 22:28:34.346544 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:34.346135 2575 scope.go:117] "RemoveContainer" containerID="6467c72bd088f9fa4c901df61ef866e6b5668b188aac8b1056caa52441e4a5f4" Jul 23 22:28:34.355318 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:34.355303 2575 scope.go:117] "RemoveContainer" containerID="6467c72bd088f9fa4c901df61ef866e6b5668b188aac8b1056caa52441e4a5f4" Jul 23 22:28:34.355574 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:28:34.355554 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6467c72bd088f9fa4c901df61ef866e6b5668b188aac8b1056caa52441e4a5f4\": container with ID starting with 6467c72bd088f9fa4c901df61ef866e6b5668b188aac8b1056caa52441e4a5f4 not found: ID does not exist" containerID="6467c72bd088f9fa4c901df61ef866e6b5668b188aac8b1056caa52441e4a5f4" Jul 23 22:28:34.355633 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:34.355585 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6467c72bd088f9fa4c901df61ef866e6b5668b188aac8b1056caa52441e4a5f4"} err="failed to get container status \"6467c72bd088f9fa4c901df61ef866e6b5668b188aac8b1056caa52441e4a5f4\": rpc error: code = NotFound desc = could not find container \"6467c72bd088f9fa4c901df61ef866e6b5668b188aac8b1056caa52441e4a5f4\": container with ID starting with 6467c72bd088f9fa4c901df61ef866e6b5668b188aac8b1056caa52441e4a5f4 not found: ID does not exist" Jul 23 22:28:34.368594 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:34.368569 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dtbr6"] Jul 23 22:28:34.372768 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:34.372747 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dtbr6"] Jul 23 22:28:34.807718 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:34.807688 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="523a4efa-1562-4a33-ba53-80795258764d" path="/var/lib/kubelet/pods/523a4efa-1562-4a33-ba53-80795258764d/volumes" Jul 23 22:28:41.558005 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:41.557974 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-kfxxn" Jul 23 22:28:41.558460 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:41.558070 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-kfxxn" Jul 23 22:28:41.579593 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:41.579572 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-kfxxn" Jul 23 22:28:42.401846 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:42.401822 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-kfxxn" Jul 23 22:28:45.886839 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:45.886768 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bbmw7"] Jul 23 22:28:45.887220 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:45.887094 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="523a4efa-1562-4a33-ba53-80795258764d" containerName="registry-server" Jul 23 22:28:45.887220 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:45.887105 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="523a4efa-1562-4a33-ba53-80795258764d" containerName="registry-server" Jul 23 22:28:45.887220 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:45.887184 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="523a4efa-1562-4a33-ba53-80795258764d" containerName="registry-server" Jul 23 22:28:45.889210 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:45.889194 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bbmw7" Jul 23 22:28:45.892527 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:45.892494 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-hkrpr\"" Jul 23 22:28:45.900222 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:45.900172 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bbmw7"] Jul 23 22:28:45.935964 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:45.935934 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7lhw\" (UniqueName: \"kubernetes.io/projected/c7aed277-7f43-4f75-af77-33f463bac977-kube-api-access-h7lhw\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bbmw7\" (UID: \"c7aed277-7f43-4f75-af77-33f463bac977\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bbmw7" Jul 23 22:28:45.936088 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:45.935993 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7aed277-7f43-4f75-af77-33f463bac977-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bbmw7\" (UID: \"c7aed277-7f43-4f75-af77-33f463bac977\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bbmw7" Jul 23 22:28:45.936088 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:45.936015 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7aed277-7f43-4f75-af77-33f463bac977-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bbmw7\" (UID: \"c7aed277-7f43-4f75-af77-33f463bac977\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bbmw7" Jul 23 22:28:46.037112 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:46.037090 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7aed277-7f43-4f75-af77-33f463bac977-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bbmw7\" (UID: \"c7aed277-7f43-4f75-af77-33f463bac977\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bbmw7" Jul 23 22:28:46.037203 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:46.037115 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7aed277-7f43-4f75-af77-33f463bac977-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bbmw7\" (UID: \"c7aed277-7f43-4f75-af77-33f463bac977\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bbmw7" Jul 23 22:28:46.037203 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:46.037149 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7lhw\" (UniqueName: \"kubernetes.io/projected/c7aed277-7f43-4f75-af77-33f463bac977-kube-api-access-h7lhw\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bbmw7\" (UID: \"c7aed277-7f43-4f75-af77-33f463bac977\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bbmw7" Jul 23 22:28:46.037433 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:46.037415 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7aed277-7f43-4f75-af77-33f463bac977-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bbmw7\" (UID: \"c7aed277-7f43-4f75-af77-33f463bac977\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bbmw7" Jul 23 22:28:46.037495 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:46.037453 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7aed277-7f43-4f75-af77-33f463bac977-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bbmw7\" (UID: \"c7aed277-7f43-4f75-af77-33f463bac977\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bbmw7" Jul 23 22:28:46.047007 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:46.046983 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7lhw\" (UniqueName: \"kubernetes.io/projected/c7aed277-7f43-4f75-af77-33f463bac977-kube-api-access-h7lhw\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bbmw7\" (UID: \"c7aed277-7f43-4f75-af77-33f463bac977\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bbmw7" Jul 23 22:28:46.198229 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:46.198208 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bbmw7" Jul 23 22:28:46.322889 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:46.322867 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bbmw7"] Jul 23 22:28:46.324887 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:28:46.324860 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7aed277_7f43_4f75_af77_33f463bac977.slice/crio-1902fd45bfdc62d5263a6410c5dadc38bd42392e4931b93c60abd630c0266315 WatchSource:0}: Error finding container 1902fd45bfdc62d5263a6410c5dadc38bd42392e4931b93c60abd630c0266315: Status 404 returned error can't find the container with id 1902fd45bfdc62d5263a6410c5dadc38bd42392e4931b93c60abd630c0266315 Jul 23 22:28:46.398975 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:46.398946 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bbmw7" event={"ID":"c7aed277-7f43-4f75-af77-33f463bac977","Type":"ContainerStarted","Data":"1b0e0094481752e59352e9b4ac777b4771555f4715fe013f5105ffd7032b6688"} Jul 23 22:28:46.399105 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:46.399012 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bbmw7" event={"ID":"c7aed277-7f43-4f75-af77-33f463bac977","Type":"ContainerStarted","Data":"1902fd45bfdc62d5263a6410c5dadc38bd42392e4931b93c60abd630c0266315"} Jul 23 22:28:46.688918 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:46.688895 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sgpl8"] Jul 23 22:28:46.691487 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:46.691473 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sgpl8" Jul 23 22:28:46.703943 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:46.703921 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sgpl8"] Jul 23 22:28:46.743172 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:46.743150 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/65fae1ae-9145-4942-be19-4e0736b5fbcf-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sgpl8\" (UID: \"65fae1ae-9145-4942-be19-4e0736b5fbcf\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sgpl8" Jul 23 22:28:46.743279 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:46.743191 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfssl\" (UniqueName: \"kubernetes.io/projected/65fae1ae-9145-4942-be19-4e0736b5fbcf-kube-api-access-jfssl\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sgpl8\" (UID: \"65fae1ae-9145-4942-be19-4e0736b5fbcf\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sgpl8" Jul 23 22:28:46.743279 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:46.743254 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/65fae1ae-9145-4942-be19-4e0736b5fbcf-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sgpl8\" (UID: \"65fae1ae-9145-4942-be19-4e0736b5fbcf\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sgpl8" Jul 23 22:28:46.844296 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:46.844271 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/65fae1ae-9145-4942-be19-4e0736b5fbcf-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sgpl8\" (UID: \"65fae1ae-9145-4942-be19-4e0736b5fbcf\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sgpl8" Jul 23 22:28:46.844410 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:46.844325 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/65fae1ae-9145-4942-be19-4e0736b5fbcf-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sgpl8\" (UID: \"65fae1ae-9145-4942-be19-4e0736b5fbcf\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sgpl8" Jul 23 22:28:46.844410 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:46.844364 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfssl\" (UniqueName: \"kubernetes.io/projected/65fae1ae-9145-4942-be19-4e0736b5fbcf-kube-api-access-jfssl\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sgpl8\" (UID: \"65fae1ae-9145-4942-be19-4e0736b5fbcf\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sgpl8" Jul 23 22:28:46.844651 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:46.844631 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/65fae1ae-9145-4942-be19-4e0736b5fbcf-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sgpl8\" (UID: \"65fae1ae-9145-4942-be19-4e0736b5fbcf\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sgpl8" Jul 23 22:28:46.844710 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:46.844658 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/65fae1ae-9145-4942-be19-4e0736b5fbcf-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sgpl8\" (UID: \"65fae1ae-9145-4942-be19-4e0736b5fbcf\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sgpl8" Jul 23 22:28:46.852857 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:46.852842 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfssl\" (UniqueName: \"kubernetes.io/projected/65fae1ae-9145-4942-be19-4e0736b5fbcf-kube-api-access-jfssl\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sgpl8\" (UID: \"65fae1ae-9145-4942-be19-4e0736b5fbcf\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sgpl8" Jul 23 22:28:46.999771 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:46.999718 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sgpl8" Jul 23 22:28:47.098132 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:47.098106 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j5xdn"] Jul 23 22:28:47.101594 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:47.101569 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j5xdn" Jul 23 22:28:47.129816 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:47.129789 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j5xdn"] Jul 23 22:28:47.146734 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:47.146579 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/39d4f5d9-1ac2-435d-8226-52432dec566a-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j5xdn\" (UID: \"39d4f5d9-1ac2-435d-8226-52432dec566a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j5xdn" Jul 23 22:28:47.146734 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:47.146687 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/39d4f5d9-1ac2-435d-8226-52432dec566a-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j5xdn\" (UID: \"39d4f5d9-1ac2-435d-8226-52432dec566a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j5xdn" Jul 23 22:28:47.146934 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:47.146783 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgrhd\" (UniqueName: \"kubernetes.io/projected/39d4f5d9-1ac2-435d-8226-52432dec566a-kube-api-access-pgrhd\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j5xdn\" (UID: \"39d4f5d9-1ac2-435d-8226-52432dec566a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j5xdn" Jul 23 22:28:47.149385 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:47.149363 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sgpl8"] Jul 23 22:28:47.150801 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:28:47.150777 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65fae1ae_9145_4942_be19_4e0736b5fbcf.slice/crio-1328363d268ed9d53de35e20ac816c2cc6b9761d40ddf9330cd1da04eb764874 WatchSource:0}: Error finding container 1328363d268ed9d53de35e20ac816c2cc6b9761d40ddf9330cd1da04eb764874: Status 404 returned error can't find the container with id 1328363d268ed9d53de35e20ac816c2cc6b9761d40ddf9330cd1da04eb764874 Jul 23 22:28:47.247913 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:47.247886 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/39d4f5d9-1ac2-435d-8226-52432dec566a-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j5xdn\" (UID: \"39d4f5d9-1ac2-435d-8226-52432dec566a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j5xdn" Jul 23 22:28:47.247994 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:47.247929 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/39d4f5d9-1ac2-435d-8226-52432dec566a-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j5xdn\" (UID: \"39d4f5d9-1ac2-435d-8226-52432dec566a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j5xdn" Jul 23 22:28:47.247994 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:47.247974 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgrhd\" (UniqueName: \"kubernetes.io/projected/39d4f5d9-1ac2-435d-8226-52432dec566a-kube-api-access-pgrhd\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j5xdn\" (UID: \"39d4f5d9-1ac2-435d-8226-52432dec566a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j5xdn" Jul 23 22:28:47.248307 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:47.248289 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/39d4f5d9-1ac2-435d-8226-52432dec566a-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j5xdn\" (UID: \"39d4f5d9-1ac2-435d-8226-52432dec566a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j5xdn" Jul 23 22:28:47.248347 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:47.248305 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/39d4f5d9-1ac2-435d-8226-52432dec566a-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j5xdn\" (UID: \"39d4f5d9-1ac2-435d-8226-52432dec566a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j5xdn" Jul 23 22:28:47.259927 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:47.259885 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgrhd\" (UniqueName: \"kubernetes.io/projected/39d4f5d9-1ac2-435d-8226-52432dec566a-kube-api-access-pgrhd\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j5xdn\" (UID: \"39d4f5d9-1ac2-435d-8226-52432dec566a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j5xdn" Jul 23 22:28:47.404526 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:47.404496 2575 generic.go:356] "Generic (PLEG): container finished" podID="65fae1ae-9145-4942-be19-4e0736b5fbcf" containerID="ca52a3ec54e963832e72b64c9478581f2327b86af560e469ca0b5bfd0c275064" exitCode=0 Jul 23 22:28:47.404634 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:47.404577 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sgpl8" event={"ID":"65fae1ae-9145-4942-be19-4e0736b5fbcf","Type":"ContainerDied","Data":"ca52a3ec54e963832e72b64c9478581f2327b86af560e469ca0b5bfd0c275064"} Jul 23 22:28:47.404634 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:47.404626 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sgpl8" event={"ID":"65fae1ae-9145-4942-be19-4e0736b5fbcf","Type":"ContainerStarted","Data":"1328363d268ed9d53de35e20ac816c2cc6b9761d40ddf9330cd1da04eb764874"} Jul 23 22:28:47.406156 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:47.406134 2575 generic.go:356] "Generic (PLEG): container finished" podID="c7aed277-7f43-4f75-af77-33f463bac977" containerID="1b0e0094481752e59352e9b4ac777b4771555f4715fe013f5105ffd7032b6688" exitCode=0 Jul 23 22:28:47.406240 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:47.406216 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bbmw7" event={"ID":"c7aed277-7f43-4f75-af77-33f463bac977","Type":"ContainerDied","Data":"1b0e0094481752e59352e9b4ac777b4771555f4715fe013f5105ffd7032b6688"} Jul 23 22:28:47.412753 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:47.412736 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j5xdn" Jul 23 22:28:47.496400 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:47.496366 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08z5gq"] Jul 23 22:28:47.500299 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:47.500277 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08z5gq" Jul 23 22:28:47.510225 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:47.509579 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08z5gq"] Jul 23 22:28:47.545349 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:47.545328 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j5xdn"] Jul 23 22:28:47.546673 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:28:47.546651 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39d4f5d9_1ac2_435d_8226_52432dec566a.slice/crio-9008b7b4f073074e154c13f47fd1eb7283b11b7e4543b5b8ac2785aef740d3cd WatchSource:0}: Error finding container 9008b7b4f073074e154c13f47fd1eb7283b11b7e4543b5b8ac2785aef740d3cd: Status 404 returned error can't find the container with id 9008b7b4f073074e154c13f47fd1eb7283b11b7e4543b5b8ac2785aef740d3cd Jul 23 22:28:47.550487 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:47.550467 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f34302e-066b-4c26-905f-e36dc7a0be8c-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08z5gq\" (UID: \"6f34302e-066b-4c26-905f-e36dc7a0be8c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08z5gq" Jul 23 22:28:47.550571 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:47.550495 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f34302e-066b-4c26-905f-e36dc7a0be8c-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08z5gq\" (UID: \"6f34302e-066b-4c26-905f-e36dc7a0be8c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08z5gq" Jul 23 22:28:47.550571 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:47.550529 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zklk\" (UniqueName: \"kubernetes.io/projected/6f34302e-066b-4c26-905f-e36dc7a0be8c-kube-api-access-2zklk\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08z5gq\" (UID: \"6f34302e-066b-4c26-905f-e36dc7a0be8c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08z5gq" Jul 23 22:28:47.651173 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:47.651149 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f34302e-066b-4c26-905f-e36dc7a0be8c-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08z5gq\" (UID: \"6f34302e-066b-4c26-905f-e36dc7a0be8c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08z5gq" Jul 23 22:28:47.651261 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:47.651180 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f34302e-066b-4c26-905f-e36dc7a0be8c-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08z5gq\" (UID: \"6f34302e-066b-4c26-905f-e36dc7a0be8c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08z5gq" Jul 23 22:28:47.651371 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:47.651312 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zklk\" (UniqueName: \"kubernetes.io/projected/6f34302e-066b-4c26-905f-e36dc7a0be8c-kube-api-access-2zklk\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08z5gq\" (UID: \"6f34302e-066b-4c26-905f-e36dc7a0be8c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08z5gq" Jul 23 22:28:47.651471 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:47.651457 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f34302e-066b-4c26-905f-e36dc7a0be8c-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08z5gq\" (UID: \"6f34302e-066b-4c26-905f-e36dc7a0be8c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08z5gq" Jul 23 22:28:47.651524 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:47.651507 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f34302e-066b-4c26-905f-e36dc7a0be8c-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08z5gq\" (UID: \"6f34302e-066b-4c26-905f-e36dc7a0be8c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08z5gq" Jul 23 22:28:47.659910 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:47.659889 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zklk\" (UniqueName: \"kubernetes.io/projected/6f34302e-066b-4c26-905f-e36dc7a0be8c-kube-api-access-2zklk\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08z5gq\" (UID: \"6f34302e-066b-4c26-905f-e36dc7a0be8c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08z5gq" Jul 23 22:28:47.813500 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:47.813450 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08z5gq" Jul 23 22:28:47.937452 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:47.937430 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08z5gq"] Jul 23 22:28:47.938689 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:28:47.938661 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f34302e_066b_4c26_905f_e36dc7a0be8c.slice/crio-09228eee8943709a83295b6d22a6bdaa8ddc219b220896b0d04f3e47f2812a94 WatchSource:0}: Error finding container 09228eee8943709a83295b6d22a6bdaa8ddc219b220896b0d04f3e47f2812a94: Status 404 returned error can't find the container with id 09228eee8943709a83295b6d22a6bdaa8ddc219b220896b0d04f3e47f2812a94 Jul 23 22:28:48.411882 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:48.411859 2575 generic.go:356] "Generic (PLEG): container finished" podID="65fae1ae-9145-4942-be19-4e0736b5fbcf" containerID="0ee79d0fad038904314dc658ebe7f984550417d6895cb80dd0ee342f18e081ca" exitCode=0 Jul 23 22:28:48.412257 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:48.411939 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sgpl8" event={"ID":"65fae1ae-9145-4942-be19-4e0736b5fbcf","Type":"ContainerDied","Data":"0ee79d0fad038904314dc658ebe7f984550417d6895cb80dd0ee342f18e081ca"} Jul 23 22:28:48.413630 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:48.413608 2575 generic.go:356] "Generic (PLEG): container finished" podID="39d4f5d9-1ac2-435d-8226-52432dec566a" containerID="75f1a60007b21f29bff90d3a6670e86dbd549c118f056b87500468eac46dc3e3" exitCode=0 Jul 23 22:28:48.413720 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:48.413676 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j5xdn" event={"ID":"39d4f5d9-1ac2-435d-8226-52432dec566a","Type":"ContainerDied","Data":"75f1a60007b21f29bff90d3a6670e86dbd549c118f056b87500468eac46dc3e3"} Jul 23 22:28:48.413786 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:48.413723 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j5xdn" event={"ID":"39d4f5d9-1ac2-435d-8226-52432dec566a","Type":"ContainerStarted","Data":"9008b7b4f073074e154c13f47fd1eb7283b11b7e4543b5b8ac2785aef740d3cd"} Jul 23 22:28:48.415396 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:48.415378 2575 generic.go:356] "Generic (PLEG): container finished" podID="c7aed277-7f43-4f75-af77-33f463bac977" containerID="307e8b3d77d0237ac142c839e70f0917f66bf1ad3abd5436b90b111ad471443f" exitCode=0 Jul 23 22:28:48.415500 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:48.415460 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bbmw7" event={"ID":"c7aed277-7f43-4f75-af77-33f463bac977","Type":"ContainerDied","Data":"307e8b3d77d0237ac142c839e70f0917f66bf1ad3abd5436b90b111ad471443f"} Jul 23 22:28:48.417307 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:48.417275 2575 generic.go:356] "Generic (PLEG): container finished" podID="6f34302e-066b-4c26-905f-e36dc7a0be8c" containerID="41f197cb016e6e92eda8ca25dd85447b766fe037bc1f3091ccc4bb25a072f73e" exitCode=0 Jul 23 22:28:48.417391 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:48.417306 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08z5gq" event={"ID":"6f34302e-066b-4c26-905f-e36dc7a0be8c","Type":"ContainerDied","Data":"41f197cb016e6e92eda8ca25dd85447b766fe037bc1f3091ccc4bb25a072f73e"} Jul 23 22:28:48.417391 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:48.417352 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08z5gq" event={"ID":"6f34302e-066b-4c26-905f-e36dc7a0be8c","Type":"ContainerStarted","Data":"09228eee8943709a83295b6d22a6bdaa8ddc219b220896b0d04f3e47f2812a94"} Jul 23 22:28:49.423852 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:49.423821 2575 generic.go:356] "Generic (PLEG): container finished" podID="c7aed277-7f43-4f75-af77-33f463bac977" containerID="28e4b888a7e122988799389db02cfd8f0b4708eb28a14d8bc64fdde1fc69eeea" exitCode=0 Jul 23 22:28:49.424194 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:49.423900 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bbmw7" event={"ID":"c7aed277-7f43-4f75-af77-33f463bac977","Type":"ContainerDied","Data":"28e4b888a7e122988799389db02cfd8f0b4708eb28a14d8bc64fdde1fc69eeea"} Jul 23 22:28:49.425645 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:49.425624 2575 generic.go:356] "Generic (PLEG): container finished" podID="6f34302e-066b-4c26-905f-e36dc7a0be8c" containerID="e46dfb6015cf1d38dae61ee77e1a37c4d272c25e1ea6bc0e61a4dce8c9872f5b" exitCode=0 Jul 23 22:28:49.425742 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:49.425702 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08z5gq" event={"ID":"6f34302e-066b-4c26-905f-e36dc7a0be8c","Type":"ContainerDied","Data":"e46dfb6015cf1d38dae61ee77e1a37c4d272c25e1ea6bc0e61a4dce8c9872f5b"} Jul 23 22:28:49.427829 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:49.427808 2575 generic.go:356] "Generic (PLEG): container finished" podID="65fae1ae-9145-4942-be19-4e0736b5fbcf" containerID="d5c6b49350d0895465eed648ad271a595caca78c6cd1980726ec15efdb847a72" exitCode=0 Jul 23 22:28:49.427938 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:49.427871 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sgpl8" event={"ID":"65fae1ae-9145-4942-be19-4e0736b5fbcf","Type":"ContainerDied","Data":"d5c6b49350d0895465eed648ad271a595caca78c6cd1980726ec15efdb847a72"} Jul 23 22:28:49.429583 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:49.429561 2575 generic.go:356] "Generic (PLEG): container finished" podID="39d4f5d9-1ac2-435d-8226-52432dec566a" containerID="556c2adbadef8904d6395aea248fd5cd01f967c2d26986b4e463746e5eb60043" exitCode=0 Jul 23 22:28:49.429670 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:49.429595 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j5xdn" event={"ID":"39d4f5d9-1ac2-435d-8226-52432dec566a","Type":"ContainerDied","Data":"556c2adbadef8904d6395aea248fd5cd01f967c2d26986b4e463746e5eb60043"} Jul 23 22:28:50.436119 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:50.436089 2575 generic.go:356] "Generic (PLEG): container finished" podID="39d4f5d9-1ac2-435d-8226-52432dec566a" containerID="400dd48c14dd7da330e2431b8b4859935e45708ad1bcc04a3d1b991694a88c41" exitCode=0 Jul 23 22:28:50.436511 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:50.436179 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j5xdn" event={"ID":"39d4f5d9-1ac2-435d-8226-52432dec566a","Type":"ContainerDied","Data":"400dd48c14dd7da330e2431b8b4859935e45708ad1bcc04a3d1b991694a88c41"} Jul 23 22:28:50.438153 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:50.438134 2575 generic.go:356] "Generic (PLEG): container finished" podID="6f34302e-066b-4c26-905f-e36dc7a0be8c" containerID="9b09553f85d16076df428a47d81eec42dbaf3668635d7fe33e241d4ad9f89346" exitCode=0 Jul 23 22:28:50.438247 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:50.438217 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08z5gq" event={"ID":"6f34302e-066b-4c26-905f-e36dc7a0be8c","Type":"ContainerDied","Data":"9b09553f85d16076df428a47d81eec42dbaf3668635d7fe33e241d4ad9f89346"} Jul 23 22:28:50.569613 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:50.569589 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sgpl8" Jul 23 22:28:50.601358 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:50.601334 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bbmw7" Jul 23 22:28:50.679807 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:50.679784 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/65fae1ae-9145-4942-be19-4e0736b5fbcf-bundle\") pod \"65fae1ae-9145-4942-be19-4e0736b5fbcf\" (UID: \"65fae1ae-9145-4942-be19-4e0736b5fbcf\") " Jul 23 22:28:50.679916 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:50.679825 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h7lhw\" (UniqueName: \"kubernetes.io/projected/c7aed277-7f43-4f75-af77-33f463bac977-kube-api-access-h7lhw\") pod \"c7aed277-7f43-4f75-af77-33f463bac977\" (UID: \"c7aed277-7f43-4f75-af77-33f463bac977\") " Jul 23 22:28:50.679916 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:50.679874 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/65fae1ae-9145-4942-be19-4e0736b5fbcf-util\") pod \"65fae1ae-9145-4942-be19-4e0736b5fbcf\" (UID: \"65fae1ae-9145-4942-be19-4e0736b5fbcf\") " Jul 23 22:28:50.680004 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:50.679916 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jfssl\" (UniqueName: \"kubernetes.io/projected/65fae1ae-9145-4942-be19-4e0736b5fbcf-kube-api-access-jfssl\") pod \"65fae1ae-9145-4942-be19-4e0736b5fbcf\" (UID: \"65fae1ae-9145-4942-be19-4e0736b5fbcf\") " Jul 23 22:28:50.680004 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:50.679968 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7aed277-7f43-4f75-af77-33f463bac977-util\") pod \"c7aed277-7f43-4f75-af77-33f463bac977\" (UID: \"c7aed277-7f43-4f75-af77-33f463bac977\") " Jul 23 22:28:50.680004 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:50.679994 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7aed277-7f43-4f75-af77-33f463bac977-bundle\") pod \"c7aed277-7f43-4f75-af77-33f463bac977\" (UID: \"c7aed277-7f43-4f75-af77-33f463bac977\") " Jul 23 22:28:50.680767 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:50.680561 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65fae1ae-9145-4942-be19-4e0736b5fbcf-bundle" (OuterVolumeSpecName: "bundle") pod "65fae1ae-9145-4942-be19-4e0736b5fbcf" (UID: "65fae1ae-9145-4942-be19-4e0736b5fbcf"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 22:28:50.680767 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:50.680614 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7aed277-7f43-4f75-af77-33f463bac977-bundle" (OuterVolumeSpecName: "bundle") pod "c7aed277-7f43-4f75-af77-33f463bac977" (UID: "c7aed277-7f43-4f75-af77-33f463bac977"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 22:28:50.682301 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:50.682275 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7aed277-7f43-4f75-af77-33f463bac977-kube-api-access-h7lhw" (OuterVolumeSpecName: "kube-api-access-h7lhw") pod "c7aed277-7f43-4f75-af77-33f463bac977" (UID: "c7aed277-7f43-4f75-af77-33f463bac977"). InnerVolumeSpecName "kube-api-access-h7lhw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 22:28:50.682402 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:50.682364 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65fae1ae-9145-4942-be19-4e0736b5fbcf-kube-api-access-jfssl" (OuterVolumeSpecName: "kube-api-access-jfssl") pod "65fae1ae-9145-4942-be19-4e0736b5fbcf" (UID: "65fae1ae-9145-4942-be19-4e0736b5fbcf"). InnerVolumeSpecName "kube-api-access-jfssl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 22:28:50.686166 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:50.686112 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65fae1ae-9145-4942-be19-4e0736b5fbcf-util" (OuterVolumeSpecName: "util") pod "65fae1ae-9145-4942-be19-4e0736b5fbcf" (UID: "65fae1ae-9145-4942-be19-4e0736b5fbcf"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 22:28:50.686468 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:50.686447 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7aed277-7f43-4f75-af77-33f463bac977-util" (OuterVolumeSpecName: "util") pod "c7aed277-7f43-4f75-af77-33f463bac977" (UID: "c7aed277-7f43-4f75-af77-33f463bac977"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 22:28:50.781327 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:50.781298 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jfssl\" (UniqueName: \"kubernetes.io/projected/65fae1ae-9145-4942-be19-4e0736b5fbcf-kube-api-access-jfssl\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 22:28:50.781327 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:50.781324 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7aed277-7f43-4f75-af77-33f463bac977-util\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 22:28:50.781327 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:50.781335 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7aed277-7f43-4f75-af77-33f463bac977-bundle\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 22:28:50.781518 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:50.781343 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/65fae1ae-9145-4942-be19-4e0736b5fbcf-bundle\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 22:28:50.781518 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:50.781352 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h7lhw\" (UniqueName: \"kubernetes.io/projected/c7aed277-7f43-4f75-af77-33f463bac977-kube-api-access-h7lhw\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 22:28:50.781518 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:50.781361 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/65fae1ae-9145-4942-be19-4e0736b5fbcf-util\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 22:28:51.444915 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:51.444889 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sgpl8" Jul 23 22:28:51.445333 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:51.444893 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sgpl8" event={"ID":"65fae1ae-9145-4942-be19-4e0736b5fbcf","Type":"ContainerDied","Data":"1328363d268ed9d53de35e20ac816c2cc6b9761d40ddf9330cd1da04eb764874"} Jul 23 22:28:51.445333 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:51.445004 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1328363d268ed9d53de35e20ac816c2cc6b9761d40ddf9330cd1da04eb764874" Jul 23 22:28:51.446865 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:51.446839 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bbmw7" Jul 23 22:28:51.446982 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:51.446900 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bbmw7" event={"ID":"c7aed277-7f43-4f75-af77-33f463bac977","Type":"ContainerDied","Data":"1902fd45bfdc62d5263a6410c5dadc38bd42392e4931b93c60abd630c0266315"} Jul 23 22:28:51.446982 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:51.446937 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1902fd45bfdc62d5263a6410c5dadc38bd42392e4931b93c60abd630c0266315" Jul 23 22:28:51.603017 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:51.602996 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08z5gq" Jul 23 22:28:51.604959 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:51.604942 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j5xdn" Jul 23 22:28:51.689250 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:51.689213 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f34302e-066b-4c26-905f-e36dc7a0be8c-util\") pod \"6f34302e-066b-4c26-905f-e36dc7a0be8c\" (UID: \"6f34302e-066b-4c26-905f-e36dc7a0be8c\") " Jul 23 22:28:51.689250 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:51.689260 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/39d4f5d9-1ac2-435d-8226-52432dec566a-util\") pod \"39d4f5d9-1ac2-435d-8226-52432dec566a\" (UID: \"39d4f5d9-1ac2-435d-8226-52432dec566a\") " Jul 23 22:28:51.689405 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:51.689285 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/39d4f5d9-1ac2-435d-8226-52432dec566a-bundle\") pod \"39d4f5d9-1ac2-435d-8226-52432dec566a\" (UID: \"39d4f5d9-1ac2-435d-8226-52432dec566a\") " Jul 23 22:28:51.689405 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:51.689303 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pgrhd\" (UniqueName: \"kubernetes.io/projected/39d4f5d9-1ac2-435d-8226-52432dec566a-kube-api-access-pgrhd\") pod \"39d4f5d9-1ac2-435d-8226-52432dec566a\" (UID: \"39d4f5d9-1ac2-435d-8226-52432dec566a\") " Jul 23 22:28:51.689405 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:51.689363 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f34302e-066b-4c26-905f-e36dc7a0be8c-bundle\") pod \"6f34302e-066b-4c26-905f-e36dc7a0be8c\" (UID: \"6f34302e-066b-4c26-905f-e36dc7a0be8c\") " Jul 23 22:28:51.689405 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:51.689395 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2zklk\" (UniqueName: \"kubernetes.io/projected/6f34302e-066b-4c26-905f-e36dc7a0be8c-kube-api-access-2zklk\") pod \"6f34302e-066b-4c26-905f-e36dc7a0be8c\" (UID: \"6f34302e-066b-4c26-905f-e36dc7a0be8c\") " Jul 23 22:28:51.689813 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:51.689781 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39d4f5d9-1ac2-435d-8226-52432dec566a-bundle" (OuterVolumeSpecName: "bundle") pod "39d4f5d9-1ac2-435d-8226-52432dec566a" (UID: "39d4f5d9-1ac2-435d-8226-52432dec566a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 22:28:51.689954 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:51.689925 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f34302e-066b-4c26-905f-e36dc7a0be8c-bundle" (OuterVolumeSpecName: "bundle") pod "6f34302e-066b-4c26-905f-e36dc7a0be8c" (UID: "6f34302e-066b-4c26-905f-e36dc7a0be8c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 22:28:51.691388 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:51.691364 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39d4f5d9-1ac2-435d-8226-52432dec566a-kube-api-access-pgrhd" (OuterVolumeSpecName: "kube-api-access-pgrhd") pod "39d4f5d9-1ac2-435d-8226-52432dec566a" (UID: "39d4f5d9-1ac2-435d-8226-52432dec566a"). InnerVolumeSpecName "kube-api-access-pgrhd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 22:28:51.691488 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:51.691440 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f34302e-066b-4c26-905f-e36dc7a0be8c-kube-api-access-2zklk" (OuterVolumeSpecName: "kube-api-access-2zklk") pod "6f34302e-066b-4c26-905f-e36dc7a0be8c" (UID: "6f34302e-066b-4c26-905f-e36dc7a0be8c"). InnerVolumeSpecName "kube-api-access-2zklk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 22:28:51.698172 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:51.698147 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f34302e-066b-4c26-905f-e36dc7a0be8c-util" (OuterVolumeSpecName: "util") pod "6f34302e-066b-4c26-905f-e36dc7a0be8c" (UID: "6f34302e-066b-4c26-905f-e36dc7a0be8c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 22:28:51.698562 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:51.698546 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39d4f5d9-1ac2-435d-8226-52432dec566a-util" (OuterVolumeSpecName: "util") pod "39d4f5d9-1ac2-435d-8226-52432dec566a" (UID: "39d4f5d9-1ac2-435d-8226-52432dec566a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 22:28:51.790322 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:51.790302 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f34302e-066b-4c26-905f-e36dc7a0be8c-bundle\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 22:28:51.790322 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:51.790322 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2zklk\" (UniqueName: \"kubernetes.io/projected/6f34302e-066b-4c26-905f-e36dc7a0be8c-kube-api-access-2zklk\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 22:28:51.790430 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:51.790332 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f34302e-066b-4c26-905f-e36dc7a0be8c-util\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 22:28:51.790430 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:51.790341 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/39d4f5d9-1ac2-435d-8226-52432dec566a-util\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 22:28:51.790430 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:51.790348 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/39d4f5d9-1ac2-435d-8226-52432dec566a-bundle\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 22:28:51.790430 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:51.790356 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pgrhd\" (UniqueName: \"kubernetes.io/projected/39d4f5d9-1ac2-435d-8226-52432dec566a-kube-api-access-pgrhd\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 22:28:52.452839 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:52.452817 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08z5gq" Jul 23 22:28:52.452839 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:52.452818 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08z5gq" event={"ID":"6f34302e-066b-4c26-905f-e36dc7a0be8c","Type":"ContainerDied","Data":"09228eee8943709a83295b6d22a6bdaa8ddc219b220896b0d04f3e47f2812a94"} Jul 23 22:28:52.453237 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:52.452865 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="09228eee8943709a83295b6d22a6bdaa8ddc219b220896b0d04f3e47f2812a94" Jul 23 22:28:52.454840 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:52.454816 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j5xdn" event={"ID":"39d4f5d9-1ac2-435d-8226-52432dec566a","Type":"ContainerDied","Data":"9008b7b4f073074e154c13f47fd1eb7283b11b7e4543b5b8ac2785aef740d3cd"} Jul 23 22:28:52.454959 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:52.454847 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j5xdn" Jul 23 22:28:52.454959 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:52.454852 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9008b7b4f073074e154c13f47fd1eb7283b11b7e4543b5b8ac2785aef740d3cd" Jul 23 22:28:53.994453 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:53.994422 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:28:57.742598 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:57.742567 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:28:58.707970 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:58.707938 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-84kq9"] Jul 23 22:28:58.708330 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:58.708317 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65fae1ae-9145-4942-be19-4e0736b5fbcf" containerName="pull" Jul 23 22:28:58.708390 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:58.708332 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="65fae1ae-9145-4942-be19-4e0736b5fbcf" containerName="pull" Jul 23 22:28:58.708390 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:58.708341 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39d4f5d9-1ac2-435d-8226-52432dec566a" containerName="util" Jul 23 22:28:58.708390 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:58.708347 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="39d4f5d9-1ac2-435d-8226-52432dec566a" containerName="util" Jul 23 22:28:58.708390 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:58.708355 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39d4f5d9-1ac2-435d-8226-52432dec566a" containerName="pull" Jul 23 22:28:58.708390 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:58.708360 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="39d4f5d9-1ac2-435d-8226-52432dec566a" containerName="pull" Jul 23 22:28:58.708390 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:58.708367 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65fae1ae-9145-4942-be19-4e0736b5fbcf" containerName="util" Jul 23 22:28:58.708390 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:58.708372 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="65fae1ae-9145-4942-be19-4e0736b5fbcf" containerName="util" Jul 23 22:28:58.708390 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:58.708381 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7aed277-7f43-4f75-af77-33f463bac977" containerName="pull" Jul 23 22:28:58.708390 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:58.708386 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7aed277-7f43-4f75-af77-33f463bac977" containerName="pull" Jul 23 22:28:58.708390 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:58.708393 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7aed277-7f43-4f75-af77-33f463bac977" containerName="util" Jul 23 22:28:58.708707 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:58.708398 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7aed277-7f43-4f75-af77-33f463bac977" containerName="util" Jul 23 22:28:58.708707 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:58.708404 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f34302e-066b-4c26-905f-e36dc7a0be8c" containerName="pull" Jul 23 22:28:58.708707 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:58.708410 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f34302e-066b-4c26-905f-e36dc7a0be8c" containerName="pull" Jul 23 22:28:58.708707 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:58.708418 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f34302e-066b-4c26-905f-e36dc7a0be8c" containerName="util" Jul 23 22:28:58.708707 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:58.708422 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f34302e-066b-4c26-905f-e36dc7a0be8c" containerName="util" Jul 23 22:28:58.708707 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:58.708432 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7aed277-7f43-4f75-af77-33f463bac977" containerName="extract" Jul 23 22:28:58.708707 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:58.708438 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7aed277-7f43-4f75-af77-33f463bac977" containerName="extract" Jul 23 22:28:58.708707 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:58.708447 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f34302e-066b-4c26-905f-e36dc7a0be8c" containerName="extract" Jul 23 22:28:58.708707 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:58.708452 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f34302e-066b-4c26-905f-e36dc7a0be8c" containerName="extract" Jul 23 22:28:58.708707 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:58.708459 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65fae1ae-9145-4942-be19-4e0736b5fbcf" containerName="extract" Jul 23 22:28:58.708707 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:58.708464 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="65fae1ae-9145-4942-be19-4e0736b5fbcf" containerName="extract" Jul 23 22:28:58.708707 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:58.708471 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39d4f5d9-1ac2-435d-8226-52432dec566a" containerName="extract" Jul 23 22:28:58.708707 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:58.708476 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="39d4f5d9-1ac2-435d-8226-52432dec566a" containerName="extract" Jul 23 22:28:58.708707 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:58.708526 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7aed277-7f43-4f75-af77-33f463bac977" containerName="extract" Jul 23 22:28:58.708707 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:58.708532 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f34302e-066b-4c26-905f-e36dc7a0be8c" containerName="extract" Jul 23 22:28:58.708707 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:58.708540 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="65fae1ae-9145-4942-be19-4e0736b5fbcf" containerName="extract" Jul 23 22:28:58.708707 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:58.708547 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="39d4f5d9-1ac2-435d-8226-52432dec566a" containerName="extract" Jul 23 22:28:58.712800 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:58.712780 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-84kq9" Jul 23 22:28:58.715746 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:58.715728 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-2llnx\"" Jul 23 22:28:58.732432 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:58.732407 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-84kq9"] Jul 23 22:28:58.739475 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:58.739453 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4z6g\" (UniqueName: \"kubernetes.io/projected/6b85193e-e75a-4fd7-af4c-72f6700d0cd7-kube-api-access-v4z6g\") pod \"kuadrant-operator-controller-manager-8684c9ff49-84kq9\" (UID: \"6b85193e-e75a-4fd7-af4c-72f6700d0cd7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-84kq9" Jul 23 22:28:58.739558 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:58.739520 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6b85193e-e75a-4fd7-af4c-72f6700d0cd7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-84kq9\" (UID: \"6b85193e-e75a-4fd7-af4c-72f6700d0cd7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-84kq9" Jul 23 22:28:58.840830 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:58.840803 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6b85193e-e75a-4fd7-af4c-72f6700d0cd7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-84kq9\" (UID: \"6b85193e-e75a-4fd7-af4c-72f6700d0cd7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-84kq9" Jul 23 22:28:58.841119 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:58.840875 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4z6g\" (UniqueName: \"kubernetes.io/projected/6b85193e-e75a-4fd7-af4c-72f6700d0cd7-kube-api-access-v4z6g\") pod \"kuadrant-operator-controller-manager-8684c9ff49-84kq9\" (UID: \"6b85193e-e75a-4fd7-af4c-72f6700d0cd7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-84kq9" Jul 23 22:28:58.841241 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:58.841222 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6b85193e-e75a-4fd7-af4c-72f6700d0cd7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-84kq9\" (UID: \"6b85193e-e75a-4fd7-af4c-72f6700d0cd7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-84kq9" Jul 23 22:28:58.858002 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:58.857984 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4z6g\" (UniqueName: \"kubernetes.io/projected/6b85193e-e75a-4fd7-af4c-72f6700d0cd7-kube-api-access-v4z6g\") pod \"kuadrant-operator-controller-manager-8684c9ff49-84kq9\" (UID: \"6b85193e-e75a-4fd7-af4c-72f6700d0cd7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-84kq9" Jul 23 22:28:58.993055 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:58.992981 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:28:59.023113 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:59.023096 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-84kq9" Jul 23 22:28:59.158827 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:59.158761 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-84kq9"] Jul 23 22:28:59.161427 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:28:59.161376 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b85193e_e75a_4fd7_af4c_72f6700d0cd7.slice/crio-0e495cb95773db7dcb014aa9d1857d9c9c91a68e4f075730b0cf2a9cd3488716 WatchSource:0}: Error finding container 0e495cb95773db7dcb014aa9d1857d9c9c91a68e4f075730b0cf2a9cd3488716: Status 404 returned error can't find the container with id 0e495cb95773db7dcb014aa9d1857d9c9c91a68e4f075730b0cf2a9cd3488716 Jul 23 22:28:59.424719 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:59.424693 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:28:59.490739 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:28:59.490708 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-84kq9" event={"ID":"6b85193e-e75a-4fd7-af4c-72f6700d0cd7","Type":"ContainerStarted","Data":"0e495cb95773db7dcb014aa9d1857d9c9c91a68e4f075730b0cf2a9cd3488716"} Jul 23 22:29:00.568603 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:00.568555 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:29:00.659066 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:00.659001 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:29:01.441937 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:01.441890 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-629zk"] Jul 23 22:29:01.445739 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:01.445714 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-629zk" Jul 23 22:29:01.448886 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:01.448863 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-fvf8g\"" Jul 23 22:29:01.460744 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:01.460680 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-629zk"] Jul 23 22:29:01.564611 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:01.564579 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkhc6\" (UniqueName: \"kubernetes.io/projected/9c995852-a2d1-48ee-874a-9e41fe5778fb-kube-api-access-bkhc6\") pod \"authorino-operator-75cc8d5cb7-629zk\" (UID: \"9c995852-a2d1-48ee-874a-9e41fe5778fb\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-629zk" Jul 23 22:29:01.665769 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:01.665731 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkhc6\" (UniqueName: \"kubernetes.io/projected/9c995852-a2d1-48ee-874a-9e41fe5778fb-kube-api-access-bkhc6\") pod \"authorino-operator-75cc8d5cb7-629zk\" (UID: \"9c995852-a2d1-48ee-874a-9e41fe5778fb\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-629zk" Jul 23 22:29:01.684660 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:01.684627 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkhc6\" (UniqueName: \"kubernetes.io/projected/9c995852-a2d1-48ee-874a-9e41fe5778fb-kube-api-access-bkhc6\") pod \"authorino-operator-75cc8d5cb7-629zk\" (UID: \"9c995852-a2d1-48ee-874a-9e41fe5778fb\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-629zk" Jul 23 22:29:01.759668 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:01.759578 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-629zk" Jul 23 22:29:01.903711 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:01.903688 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-629zk"] Jul 23 22:29:01.906291 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:29:01.906247 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c995852_a2d1_48ee_874a_9e41fe5778fb.slice/crio-6c8a944d83b5bc3b1e4003444703a2278d022c43158b972537c0c607fba88b36 WatchSource:0}: Error finding container 6c8a944d83b5bc3b1e4003444703a2278d022c43158b972537c0c607fba88b36: Status 404 returned error can't find the container with id 6c8a944d83b5bc3b1e4003444703a2278d022c43158b972537c0c607fba88b36 Jul 23 22:29:02.004674 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:02.004641 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:29:02.512416 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:02.512371 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-629zk" event={"ID":"9c995852-a2d1-48ee-874a-9e41fe5778fb","Type":"ContainerStarted","Data":"6c8a944d83b5bc3b1e4003444703a2278d022c43158b972537c0c607fba88b36"} Jul 23 22:29:03.040322 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:03.040288 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:29:03.562242 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:03.562137 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dvkmr"] Jul 23 22:29:03.565989 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:03.565963 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dvkmr" Jul 23 22:29:03.571097 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:03.570050 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-cf7cf\"" Jul 23 22:29:03.583423 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:03.580932 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dvkmr"] Jul 23 22:29:03.687810 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:03.687769 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxvf9\" (UniqueName: \"kubernetes.io/projected/47db0138-fa4f-4760-bba7-7e6045d275e5-kube-api-access-qxvf9\") pod \"limitador-operator-controller-manager-859d7b78bd-dvkmr\" (UID: \"47db0138-fa4f-4760-bba7-7e6045d275e5\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dvkmr" Jul 23 22:29:03.788993 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:03.788959 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxvf9\" (UniqueName: \"kubernetes.io/projected/47db0138-fa4f-4760-bba7-7e6045d275e5-kube-api-access-qxvf9\") pod \"limitador-operator-controller-manager-859d7b78bd-dvkmr\" (UID: \"47db0138-fa4f-4760-bba7-7e6045d275e5\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dvkmr" Jul 23 22:29:03.802127 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:03.802095 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxvf9\" (UniqueName: \"kubernetes.io/projected/47db0138-fa4f-4760-bba7-7e6045d275e5-kube-api-access-qxvf9\") pod \"limitador-operator-controller-manager-859d7b78bd-dvkmr\" (UID: \"47db0138-fa4f-4760-bba7-7e6045d275e5\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dvkmr" Jul 23 22:29:03.899391 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:03.899303 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dvkmr" Jul 23 22:29:04.406972 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:04.406941 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:29:05.459070 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:05.458929 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dvkmr"] Jul 23 22:29:05.461477 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:29:05.461449 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47db0138_fa4f_4760_bba7_7e6045d275e5.slice/crio-c31c51d76a66d3a4cbc66e1a52fce875cf3db870458e89d8aa618234bcb78f8f WatchSource:0}: Error finding container c31c51d76a66d3a4cbc66e1a52fce875cf3db870458e89d8aa618234bcb78f8f: Status 404 returned error can't find the container with id c31c51d76a66d3a4cbc66e1a52fce875cf3db870458e89d8aa618234bcb78f8f Jul 23 22:29:05.530601 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:05.530568 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dvkmr" event={"ID":"47db0138-fa4f-4760-bba7-7e6045d275e5","Type":"ContainerStarted","Data":"c31c51d76a66d3a4cbc66e1a52fce875cf3db870458e89d8aa618234bcb78f8f"} Jul 23 22:29:05.532041 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:05.531993 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-629zk" event={"ID":"9c995852-a2d1-48ee-874a-9e41fe5778fb","Type":"ContainerStarted","Data":"6e3e011993bf31d8e0c3fe75a498cb6376d388ae91720932b441cc5eb7865921"} Jul 23 22:29:05.532400 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:05.532065 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-629zk" Jul 23 22:29:05.533623 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:05.533604 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-84kq9" event={"ID":"6b85193e-e75a-4fd7-af4c-72f6700d0cd7","Type":"ContainerStarted","Data":"463673e3a2b26f40760f34455d91fc5886bdd02cb1077226c4bdb728af8080d4"} Jul 23 22:29:05.533710 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:05.533694 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-84kq9" Jul 23 22:29:05.552460 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:05.552409 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-629zk" podStartSLOduration=1.081147752 podStartE2EDuration="4.55239253s" totalImagesPullingTime="3.471244778s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 22:29:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:29:05.550911238 +0000 UTC m=+373.270908499" watchObservedRunningTime="2026-07-23 22:29:05.55239253 +0000 UTC m=+373.272389791" Jul 23 22:29:05.572786 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:05.572696 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-84kq9" podStartSLOduration=1.3730178020000001 podStartE2EDuration="7.572683663s" totalImagesPullingTime="6.199665861s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 22:28:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:29:05.570895496 +0000 UTC m=+373.290892756" watchObservedRunningTime="2026-07-23 22:29:05.572683663 +0000 UTC m=+373.292680990" Jul 23 22:29:05.637753 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:05.637725 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:29:05.994386 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:05.991620 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-fwmjl"] Jul 23 22:29:05.996787 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:05.996760 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fwmjl" Jul 23 22:29:06.004418 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:06.004379 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 23 22:29:06.005689 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:06.005599 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-zpz5c\"" Jul 23 22:29:06.008672 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:06.008649 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-fwmjl"] Jul 23 22:29:06.114540 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:06.114504 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j58bs\" (UniqueName: \"kubernetes.io/projected/44f0261d-a1b4-4630-8721-b48faa63cc98-kube-api-access-j58bs\") pod \"dns-operator-controller-manager-864dd78c4c-fwmjl\" (UID: \"44f0261d-a1b4-4630-8721-b48faa63cc98\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fwmjl" Jul 23 22:29:06.215952 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:06.215915 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j58bs\" (UniqueName: \"kubernetes.io/projected/44f0261d-a1b4-4630-8721-b48faa63cc98-kube-api-access-j58bs\") pod \"dns-operator-controller-manager-864dd78c4c-fwmjl\" (UID: \"44f0261d-a1b4-4630-8721-b48faa63cc98\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fwmjl" Jul 23 22:29:06.228323 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:06.228288 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j58bs\" (UniqueName: \"kubernetes.io/projected/44f0261d-a1b4-4630-8721-b48faa63cc98-kube-api-access-j58bs\") pod \"dns-operator-controller-manager-864dd78c4c-fwmjl\" (UID: \"44f0261d-a1b4-4630-8721-b48faa63cc98\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fwmjl" Jul 23 22:29:06.310557 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:06.310477 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fwmjl" Jul 23 22:29:06.497817 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:06.497789 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-fwmjl"] Jul 23 22:29:06.500232 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:29:06.500183 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44f0261d_a1b4_4630_8721_b48faa63cc98.slice/crio-96b0d9d9418697e2a9836fb07bc7928b404a39d30c2c4eae41dc304410df1d36 WatchSource:0}: Error finding container 96b0d9d9418697e2a9836fb07bc7928b404a39d30c2c4eae41dc304410df1d36: Status 404 returned error can't find the container with id 96b0d9d9418697e2a9836fb07bc7928b404a39d30c2c4eae41dc304410df1d36 Jul 23 22:29:06.545539 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:06.545405 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fwmjl" event={"ID":"44f0261d-a1b4-4630-8721-b48faa63cc98","Type":"ContainerStarted","Data":"96b0d9d9418697e2a9836fb07bc7928b404a39d30c2c4eae41dc304410df1d36"} Jul 23 22:29:07.553178 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:07.553137 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dvkmr" event={"ID":"47db0138-fa4f-4760-bba7-7e6045d275e5","Type":"ContainerStarted","Data":"ada54a3608ba03d9a9289a7831487202e7e721f44b7e5d691e3942bfb6b75cd2"} Jul 23 22:29:07.553666 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:07.553416 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dvkmr" Jul 23 22:29:07.575793 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:07.575746 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dvkmr" podStartSLOduration=2.990683609 podStartE2EDuration="4.575730332s" totalImagesPullingTime="1.585046723s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 22:29:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:29:07.570924911 +0000 UTC m=+375.290922170" watchObservedRunningTime="2026-07-23 22:29:07.575730332 +0000 UTC m=+375.295727591" Jul 23 22:29:08.199250 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:08.199204 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:29:08.253874 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:08.253831 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-fgrbg"] Jul 23 22:29:08.257473 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:08.257447 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fgrbg" Jul 23 22:29:08.259824 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:08.259802 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 23 22:29:08.259953 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:08.259902 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-hkrpr\"" Jul 23 22:29:08.259953 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:08.259903 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 23 22:29:08.267512 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:08.267488 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-fgrbg"] Jul 23 22:29:08.271811 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:08.271783 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:29:08.337154 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:08.337115 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/46695d21-ecd3-4a0d-8e74-c686ee386fe3-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-fgrbg\" (UID: \"46695d21-ecd3-4a0d-8e74-c686ee386fe3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fgrbg" Jul 23 22:29:08.337320 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:08.337244 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6476m\" (UniqueName: \"kubernetes.io/projected/46695d21-ecd3-4a0d-8e74-c686ee386fe3-kube-api-access-6476m\") pod \"kuadrant-console-plugin-66b5774985-fgrbg\" (UID: \"46695d21-ecd3-4a0d-8e74-c686ee386fe3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fgrbg" Jul 23 22:29:08.337320 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:08.337295 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/46695d21-ecd3-4a0d-8e74-c686ee386fe3-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-fgrbg\" (UID: \"46695d21-ecd3-4a0d-8e74-c686ee386fe3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fgrbg" Jul 23 22:29:08.438217 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:08.438176 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6476m\" (UniqueName: \"kubernetes.io/projected/46695d21-ecd3-4a0d-8e74-c686ee386fe3-kube-api-access-6476m\") pod \"kuadrant-console-plugin-66b5774985-fgrbg\" (UID: \"46695d21-ecd3-4a0d-8e74-c686ee386fe3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fgrbg" Jul 23 22:29:08.438404 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:08.438239 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/46695d21-ecd3-4a0d-8e74-c686ee386fe3-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-fgrbg\" (UID: \"46695d21-ecd3-4a0d-8e74-c686ee386fe3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fgrbg" Jul 23 22:29:08.438404 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:08.438286 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/46695d21-ecd3-4a0d-8e74-c686ee386fe3-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-fgrbg\" (UID: \"46695d21-ecd3-4a0d-8e74-c686ee386fe3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fgrbg" Jul 23 22:29:08.438404 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:29:08.438395 2575 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jul 23 22:29:08.438570 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:29:08.438461 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46695d21-ecd3-4a0d-8e74-c686ee386fe3-plugin-serving-cert podName:46695d21-ecd3-4a0d-8e74-c686ee386fe3 nodeName:}" failed. No retries permitted until 2026-07-23 22:29:08.938440161 +0000 UTC m=+376.658437399 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/46695d21-ecd3-4a0d-8e74-c686ee386fe3-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-fgrbg" (UID: "46695d21-ecd3-4a0d-8e74-c686ee386fe3") : secret "plugin-serving-cert" not found Jul 23 22:29:08.439071 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:08.439049 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/46695d21-ecd3-4a0d-8e74-c686ee386fe3-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-fgrbg\" (UID: \"46695d21-ecd3-4a0d-8e74-c686ee386fe3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fgrbg" Jul 23 22:29:08.450178 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:08.450103 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6476m\" (UniqueName: \"kubernetes.io/projected/46695d21-ecd3-4a0d-8e74-c686ee386fe3-kube-api-access-6476m\") pod \"kuadrant-console-plugin-66b5774985-fgrbg\" (UID: \"46695d21-ecd3-4a0d-8e74-c686ee386fe3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fgrbg" Jul 23 22:29:08.789848 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:08.789822 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:29:08.942254 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:08.942232 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/46695d21-ecd3-4a0d-8e74-c686ee386fe3-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-fgrbg\" (UID: \"46695d21-ecd3-4a0d-8e74-c686ee386fe3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fgrbg" Jul 23 22:29:08.944452 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:08.944427 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/46695d21-ecd3-4a0d-8e74-c686ee386fe3-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-fgrbg\" (UID: \"46695d21-ecd3-4a0d-8e74-c686ee386fe3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fgrbg" Jul 23 22:29:09.167329 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:09.167269 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fgrbg" Jul 23 22:29:09.291411 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:09.291385 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-fgrbg"] Jul 23 22:29:09.293163 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:29:09.293137 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod46695d21_ecd3_4a0d_8e74_c686ee386fe3.slice/crio-f65e9c64cafc082babd0535abd937ca6644e1d6b941616da2bc84d05e5ccca95 WatchSource:0}: Error finding container f65e9c64cafc082babd0535abd937ca6644e1d6b941616da2bc84d05e5ccca95: Status 404 returned error can't find the container with id f65e9c64cafc082babd0535abd937ca6644e1d6b941616da2bc84d05e5ccca95 Jul 23 22:29:09.566377 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:09.566345 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fgrbg" event={"ID":"46695d21-ecd3-4a0d-8e74-c686ee386fe3","Type":"ContainerStarted","Data":"f65e9c64cafc082babd0535abd937ca6644e1d6b941616da2bc84d05e5ccca95"} Jul 23 22:29:09.567798 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:09.567769 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fwmjl" event={"ID":"44f0261d-a1b4-4630-8721-b48faa63cc98","Type":"ContainerStarted","Data":"35ddb6458f13e4d7a07cf6c105f36cb7379960210a6aad5f56e8d4ce93242675"} Jul 23 22:29:09.567911 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:09.567892 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fwmjl" Jul 23 22:29:09.587566 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:09.587524 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fwmjl" podStartSLOduration=2.444541072 podStartE2EDuration="4.587510556s" totalImagesPullingTime="2.142969484s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 22:29:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:29:09.586630472 +0000 UTC m=+377.306627732" watchObservedRunningTime="2026-07-23 22:29:09.587510556 +0000 UTC m=+377.307507814" Jul 23 22:29:16.548323 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:16.548290 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-629zk" Jul 23 22:29:16.548799 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:16.548379 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-84kq9" Jul 23 22:29:18.215749 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:18.215709 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:29:18.323887 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:18.323851 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:29:18.336663 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:18.336633 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6vjx5"] Jul 23 22:29:18.358300 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:18.358251 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6vjx5" Jul 23 22:29:18.362208 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:18.362174 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6vjx5"] Jul 23 22:29:18.424234 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:18.424185 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/57d91d73-8e0a-489c-8090-26d4ee207279-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-6vjx5\" (UID: \"57d91d73-8e0a-489c-8090-26d4ee207279\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6vjx5" Jul 23 22:29:18.424371 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:18.424256 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpstt\" (UniqueName: \"kubernetes.io/projected/57d91d73-8e0a-489c-8090-26d4ee207279-kube-api-access-cpstt\") pod \"kuadrant-operator-controller-manager-55467d9f7-6vjx5\" (UID: \"57d91d73-8e0a-489c-8090-26d4ee207279\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6vjx5" Jul 23 22:29:18.525189 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:18.525089 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/57d91d73-8e0a-489c-8090-26d4ee207279-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-6vjx5\" (UID: \"57d91d73-8e0a-489c-8090-26d4ee207279\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6vjx5" Jul 23 22:29:18.525189 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:18.525159 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpstt\" (UniqueName: \"kubernetes.io/projected/57d91d73-8e0a-489c-8090-26d4ee207279-kube-api-access-cpstt\") pod \"kuadrant-operator-controller-manager-55467d9f7-6vjx5\" (UID: \"57d91d73-8e0a-489c-8090-26d4ee207279\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6vjx5" Jul 23 22:29:18.525558 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:18.525540 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/57d91d73-8e0a-489c-8090-26d4ee207279-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-6vjx5\" (UID: \"57d91d73-8e0a-489c-8090-26d4ee207279\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6vjx5" Jul 23 22:29:18.548445 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:18.548414 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpstt\" (UniqueName: \"kubernetes.io/projected/57d91d73-8e0a-489c-8090-26d4ee207279-kube-api-access-cpstt\") pod \"kuadrant-operator-controller-manager-55467d9f7-6vjx5\" (UID: \"57d91d73-8e0a-489c-8090-26d4ee207279\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6vjx5" Jul 23 22:29:18.562557 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:18.562530 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dvkmr" Jul 23 22:29:18.646009 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:18.645972 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6vjx5"] Jul 23 22:29:18.646445 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:18.646424 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6vjx5" Jul 23 22:29:18.661406 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:18.661361 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6vjx5"] Jul 23 22:29:18.686687 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:18.686655 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-84kq9"] Jul 23 22:29:18.687118 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:18.687069 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-84kq9" podUID="6b85193e-e75a-4fd7-af4c-72f6700d0cd7" containerName="manager" containerID="cri-o://463673e3a2b26f40760f34455d91fc5886bdd02cb1077226c4bdb728af8080d4" gracePeriod=2 Jul 23 22:29:18.701131 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:18.701102 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-84kq9"] Jul 23 22:29:18.710693 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:18.710665 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tm8td"] Jul 23 22:29:18.711359 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:18.711339 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b85193e-e75a-4fd7-af4c-72f6700d0cd7" containerName="manager" Jul 23 22:29:18.711492 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:18.711472 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b85193e-e75a-4fd7-af4c-72f6700d0cd7" containerName="manager" Jul 23 22:29:18.711612 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:18.711595 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b85193e-e75a-4fd7-af4c-72f6700d0cd7" containerName="manager" Jul 23 22:29:18.715211 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:18.715192 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tm8td" Jul 23 22:29:18.743946 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:18.743900 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dvkmr"] Jul 23 22:29:18.744281 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:18.744153 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dvkmr" podUID="47db0138-fa4f-4760-bba7-7e6045d275e5" containerName="manager" containerID="cri-o://ada54a3608ba03d9a9289a7831487202e7e721f44b7e5d691e3942bfb6b75cd2" gracePeriod=2 Jul 23 22:29:18.747082 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:18.747007 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dvkmr"] Jul 23 22:29:18.775149 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:18.775123 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tm8td"] Jul 23 22:29:18.813339 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:29:18.813259 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-84kq9\" is forbidden: User \"system:node:ip-10-0-134-206.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-206.ec2.internal' and this object" podUID="6b85193e-e75a-4fd7-af4c-72f6700d0cd7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-84kq9" Jul 23 22:29:18.814544 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:18.814445 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jhj4d"] Jul 23 22:29:18.814969 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:18.814948 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47db0138-fa4f-4760-bba7-7e6045d275e5" containerName="manager" Jul 23 22:29:18.815070 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:18.814972 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="47db0138-fa4f-4760-bba7-7e6045d275e5" containerName="manager" Jul 23 22:29:18.815135 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:18.815100 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="47db0138-fa4f-4760-bba7-7e6045d275e5" containerName="manager" Jul 23 22:29:18.817751 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:29:18.817720 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-84kq9\" is forbidden: User \"system:node:ip-10-0-134-206.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-206.ec2.internal' and this object" podUID="6b85193e-e75a-4fd7-af4c-72f6700d0cd7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-84kq9" Jul 23 22:29:18.820443 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:29:18.820412 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-dvkmr\" is forbidden: User \"system:node:ip-10-0-134-206.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-206.ec2.internal' and this object" podUID="47db0138-fa4f-4760-bba7-7e6045d275e5" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dvkmr" Jul 23 22:29:18.821124 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:18.821105 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sbhns"] Jul 23 22:29:18.821239 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:18.821212 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jhj4d" Jul 23 22:29:18.824986 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:18.824969 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sbhns" Jul 23 22:29:18.827172 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:18.827148 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4417103a-5e93-4347-ba0d-25a6f1010f88-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-tm8td\" (UID: \"4417103a-5e93-4347-ba0d-25a6f1010f88\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tm8td" Jul 23 22:29:18.827297 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:18.827280 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ndcc\" (UniqueName: \"kubernetes.io/projected/4417103a-5e93-4347-ba0d-25a6f1010f88-kube-api-access-9ndcc\") pod \"kuadrant-operator-controller-manager-55467d9f7-tm8td\" (UID: \"4417103a-5e93-4347-ba0d-25a6f1010f88\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tm8td" Jul 23 22:29:18.845591 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:18.845570 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jhj4d"] Jul 23 22:29:18.848439 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:18.848414 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sbhns"] Jul 23 22:29:18.928831 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:18.928785 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tmkk\" (UniqueName: \"kubernetes.io/projected/82260dc9-836e-4586-a886-94d9e966213e-kube-api-access-9tmkk\") pod \"limitador-operator-controller-manager-859d7b78bd-sbhns\" (UID: \"82260dc9-836e-4586-a886-94d9e966213e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sbhns" Jul 23 22:29:18.929036 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:18.928852 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4417103a-5e93-4347-ba0d-25a6f1010f88-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-tm8td\" (UID: \"4417103a-5e93-4347-ba0d-25a6f1010f88\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tm8td" Jul 23 22:29:18.929036 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:18.928919 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ndcc\" (UniqueName: \"kubernetes.io/projected/4417103a-5e93-4347-ba0d-25a6f1010f88-kube-api-access-9ndcc\") pod \"kuadrant-operator-controller-manager-55467d9f7-tm8td\" (UID: \"4417103a-5e93-4347-ba0d-25a6f1010f88\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tm8td" Jul 23 22:29:18.929166 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:18.929053 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d7617107-7a32-4ece-b7fa-1a176eb83fb8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jhj4d\" (UID: \"d7617107-7a32-4ece-b7fa-1a176eb83fb8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jhj4d" Jul 23 22:29:18.929166 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:18.929089 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxchx\" (UniqueName: \"kubernetes.io/projected/d7617107-7a32-4ece-b7fa-1a176eb83fb8-kube-api-access-wxchx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jhj4d\" (UID: \"d7617107-7a32-4ece-b7fa-1a176eb83fb8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jhj4d" Jul 23 22:29:18.929292 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:18.929274 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4417103a-5e93-4347-ba0d-25a6f1010f88-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-tm8td\" (UID: \"4417103a-5e93-4347-ba0d-25a6f1010f88\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tm8td" Jul 23 22:29:18.946046 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:18.945999 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ndcc\" (UniqueName: \"kubernetes.io/projected/4417103a-5e93-4347-ba0d-25a6f1010f88-kube-api-access-9ndcc\") pod \"kuadrant-operator-controller-manager-55467d9f7-tm8td\" (UID: \"4417103a-5e93-4347-ba0d-25a6f1010f88\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tm8td" Jul 23 22:29:19.030553 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:19.030525 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tmkk\" (UniqueName: \"kubernetes.io/projected/82260dc9-836e-4586-a886-94d9e966213e-kube-api-access-9tmkk\") pod \"limitador-operator-controller-manager-859d7b78bd-sbhns\" (UID: \"82260dc9-836e-4586-a886-94d9e966213e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sbhns" Jul 23 22:29:19.030732 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:19.030618 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d7617107-7a32-4ece-b7fa-1a176eb83fb8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jhj4d\" (UID: \"d7617107-7a32-4ece-b7fa-1a176eb83fb8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jhj4d" Jul 23 22:29:19.030732 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:19.030646 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxchx\" (UniqueName: \"kubernetes.io/projected/d7617107-7a32-4ece-b7fa-1a176eb83fb8-kube-api-access-wxchx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jhj4d\" (UID: \"d7617107-7a32-4ece-b7fa-1a176eb83fb8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jhj4d" Jul 23 22:29:19.031016 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:19.030992 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d7617107-7a32-4ece-b7fa-1a176eb83fb8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jhj4d\" (UID: \"d7617107-7a32-4ece-b7fa-1a176eb83fb8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jhj4d" Jul 23 22:29:19.045409 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:19.045381 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tmkk\" (UniqueName: \"kubernetes.io/projected/82260dc9-836e-4586-a886-94d9e966213e-kube-api-access-9tmkk\") pod \"limitador-operator-controller-manager-859d7b78bd-sbhns\" (UID: \"82260dc9-836e-4586-a886-94d9e966213e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sbhns" Jul 23 22:29:19.045550 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:19.045407 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxchx\" (UniqueName: \"kubernetes.io/projected/d7617107-7a32-4ece-b7fa-1a176eb83fb8-kube-api-access-wxchx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jhj4d\" (UID: \"d7617107-7a32-4ece-b7fa-1a176eb83fb8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jhj4d" Jul 23 22:29:19.062123 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:19.062098 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tm8td" Jul 23 22:29:19.138477 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:19.138447 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jhj4d" Jul 23 22:29:19.147395 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:19.147372 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sbhns" Jul 23 22:29:20.576834 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:20.576798 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fwmjl" Jul 23 22:29:21.254208 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:21.254165 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:29:21.352406 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:21.352370 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:29:23.653225 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:23.653195 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:29:23.711258 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:23.711223 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:29:29.413841 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:29.413800 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:29:29.477956 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:29.477924 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:29:30.044218 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:30.043802 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-84kq9" Jul 23 22:29:30.046551 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:29:30.046511 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-84kq9\" is forbidden: User \"system:node:ip-10-0-134-206.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-206.ec2.internal' and this object" podUID="6b85193e-e75a-4fd7-af4c-72f6700d0cd7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-84kq9" Jul 23 22:29:30.061172 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:30.061144 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dvkmr" Jul 23 22:29:30.063783 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:29:30.063759 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-84kq9\" is forbidden: User \"system:node:ip-10-0-134-206.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-206.ec2.internal' and this object" podUID="6b85193e-e75a-4fd7-af4c-72f6700d0cd7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-84kq9" Jul 23 22:29:30.066337 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:29:30.066303 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-dvkmr\" is forbidden: User \"system:node:ip-10-0-134-206.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-206.ec2.internal' and this object" podUID="47db0138-fa4f-4760-bba7-7e6045d275e5" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dvkmr" Jul 23 22:29:30.081869 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:30.081843 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sbhns"] Jul 23 22:29:30.082584 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:29:30.082540 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82260dc9_836e_4586_a886_94d9e966213e.slice/crio-7f91a6586c4704221acf82a9f4a62219996c0397adeeedd823310d0c78ea87d1 WatchSource:0}: Error finding container 7f91a6586c4704221acf82a9f4a62219996c0397adeeedd823310d0c78ea87d1: Status 404 returned error can't find the container with id 7f91a6586c4704221acf82a9f4a62219996c0397adeeedd823310d0c78ea87d1 Jul 23 22:29:30.104172 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:30.104143 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jhj4d"] Jul 23 22:29:30.109945 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:29:30.109919 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7617107_7a32_4ece_b7fa_1a176eb83fb8.slice/crio-c54a645883bfac2d6df6b9bbedb296465ea9ee2bb4296f126e83410962ff9f2f WatchSource:0}: Error finding container c54a645883bfac2d6df6b9bbedb296465ea9ee2bb4296f126e83410962ff9f2f: Status 404 returned error can't find the container with id c54a645883bfac2d6df6b9bbedb296465ea9ee2bb4296f126e83410962ff9f2f Jul 23 22:29:30.125683 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:30.125661 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tm8td"] Jul 23 22:29:30.126094 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:29:30.126071 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4417103a_5e93_4347_ba0d_25a6f1010f88.slice/crio-162c50f84010f32159d682bd7e4e76e75fdeb88d749e5409c8080a37b03f3164 WatchSource:0}: Error finding container 162c50f84010f32159d682bd7e4e76e75fdeb88d749e5409c8080a37b03f3164: Status 404 returned error can't find the container with id 162c50f84010f32159d682bd7e4e76e75fdeb88d749e5409c8080a37b03f3164 Jul 23 22:29:30.232402 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:30.232377 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v4z6g\" (UniqueName: \"kubernetes.io/projected/6b85193e-e75a-4fd7-af4c-72f6700d0cd7-kube-api-access-v4z6g\") pod \"6b85193e-e75a-4fd7-af4c-72f6700d0cd7\" (UID: \"6b85193e-e75a-4fd7-af4c-72f6700d0cd7\") " Jul 23 22:29:30.232513 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:30.232438 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qxvf9\" (UniqueName: \"kubernetes.io/projected/47db0138-fa4f-4760-bba7-7e6045d275e5-kube-api-access-qxvf9\") pod \"47db0138-fa4f-4760-bba7-7e6045d275e5\" (UID: \"47db0138-fa4f-4760-bba7-7e6045d275e5\") " Jul 23 22:29:30.232513 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:30.232480 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6b85193e-e75a-4fd7-af4c-72f6700d0cd7-extensions-socket-volume\") pod \"6b85193e-e75a-4fd7-af4c-72f6700d0cd7\" (UID: \"6b85193e-e75a-4fd7-af4c-72f6700d0cd7\") " Jul 23 22:29:30.232939 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:30.232918 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b85193e-e75a-4fd7-af4c-72f6700d0cd7-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6b85193e-e75a-4fd7-af4c-72f6700d0cd7" (UID: "6b85193e-e75a-4fd7-af4c-72f6700d0cd7"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 22:29:30.234237 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:30.234207 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b85193e-e75a-4fd7-af4c-72f6700d0cd7-kube-api-access-v4z6g" (OuterVolumeSpecName: "kube-api-access-v4z6g") pod "6b85193e-e75a-4fd7-af4c-72f6700d0cd7" (UID: "6b85193e-e75a-4fd7-af4c-72f6700d0cd7"). InnerVolumeSpecName "kube-api-access-v4z6g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 22:29:30.234323 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:30.234283 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47db0138-fa4f-4760-bba7-7e6045d275e5-kube-api-access-qxvf9" (OuterVolumeSpecName: "kube-api-access-qxvf9") pod "47db0138-fa4f-4760-bba7-7e6045d275e5" (UID: "47db0138-fa4f-4760-bba7-7e6045d275e5"). InnerVolumeSpecName "kube-api-access-qxvf9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 22:29:30.333266 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:30.333237 2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6b85193e-e75a-4fd7-af4c-72f6700d0cd7-extensions-socket-volume\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 22:29:30.333266 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:30.333261 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v4z6g\" (UniqueName: \"kubernetes.io/projected/6b85193e-e75a-4fd7-af4c-72f6700d0cd7-kube-api-access-v4z6g\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 22:29:30.333266 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:30.333270 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qxvf9\" (UniqueName: \"kubernetes.io/projected/47db0138-fa4f-4760-bba7-7e6045d275e5-kube-api-access-qxvf9\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 22:29:30.699282 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:30.699246 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sbhns" event={"ID":"82260dc9-836e-4586-a886-94d9e966213e","Type":"ContainerStarted","Data":"9ce575c61479b4ce066adaf309fa65522147f0067271a5814057d4aae86a83c1"} Jul 23 22:29:30.699713 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:30.699311 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sbhns" event={"ID":"82260dc9-836e-4586-a886-94d9e966213e","Type":"ContainerStarted","Data":"7f91a6586c4704221acf82a9f4a62219996c0397adeeedd823310d0c78ea87d1"} Jul 23 22:29:30.699713 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:30.699349 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sbhns" Jul 23 22:29:30.700898 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:30.700878 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jhj4d" event={"ID":"d7617107-7a32-4ece-b7fa-1a176eb83fb8","Type":"ContainerStarted","Data":"a199e3bf681c0479dbaab12ff030d75ff3af21e2d5b5464eb72e9ab3a1b8cae7"} Jul 23 22:29:30.700970 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:30.700921 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jhj4d" event={"ID":"d7617107-7a32-4ece-b7fa-1a176eb83fb8","Type":"ContainerStarted","Data":"c54a645883bfac2d6df6b9bbedb296465ea9ee2bb4296f126e83410962ff9f2f"} Jul 23 22:29:30.700970 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:30.700947 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jhj4d" Jul 23 22:29:30.702429 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:30.702398 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fgrbg" event={"ID":"46695d21-ecd3-4a0d-8e74-c686ee386fe3","Type":"ContainerStarted","Data":"ce02f06e99f03a89c99d9fbaa4bb63cefebb86605a5d42d2f3fd419fbe99cd9b"} Jul 23 22:29:30.703594 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:30.703570 2575 generic.go:356] "Generic (PLEG): container finished" podID="6b85193e-e75a-4fd7-af4c-72f6700d0cd7" containerID="463673e3a2b26f40760f34455d91fc5886bdd02cb1077226c4bdb728af8080d4" exitCode=0 Jul 23 22:29:30.703693 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:30.703602 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-84kq9" Jul 23 22:29:30.703693 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:30.703655 2575 scope.go:117] "RemoveContainer" containerID="463673e3a2b26f40760f34455d91fc5886bdd02cb1077226c4bdb728af8080d4" Jul 23 22:29:30.704982 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:30.704957 2575 generic.go:356] "Generic (PLEG): container finished" podID="47db0138-fa4f-4760-bba7-7e6045d275e5" containerID="ada54a3608ba03d9a9289a7831487202e7e721f44b7e5d691e3942bfb6b75cd2" exitCode=0 Jul 23 22:29:30.705110 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:30.705003 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dvkmr" Jul 23 22:29:30.706758 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:30.706729 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tm8td" event={"ID":"4417103a-5e93-4347-ba0d-25a6f1010f88","Type":"ContainerStarted","Data":"49627f8a2777f2f08ce61d7c2af479952033bbfb0b65119f2bb4c3af10f03afd"} Jul 23 22:29:30.706861 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:30.706773 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tm8td" event={"ID":"4417103a-5e93-4347-ba0d-25a6f1010f88","Type":"ContainerStarted","Data":"162c50f84010f32159d682bd7e4e76e75fdeb88d749e5409c8080a37b03f3164"} Jul 23 22:29:30.706861 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:30.706802 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tm8td" Jul 23 22:29:30.714825 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:30.714810 2575 scope.go:117] "RemoveContainer" containerID="463673e3a2b26f40760f34455d91fc5886bdd02cb1077226c4bdb728af8080d4" Jul 23 22:29:30.715085 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:29:30.715068 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"463673e3a2b26f40760f34455d91fc5886bdd02cb1077226c4bdb728af8080d4\": container with ID starting with 463673e3a2b26f40760f34455d91fc5886bdd02cb1077226c4bdb728af8080d4 not found: ID does not exist" containerID="463673e3a2b26f40760f34455d91fc5886bdd02cb1077226c4bdb728af8080d4" Jul 23 22:29:30.715164 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:30.715091 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"463673e3a2b26f40760f34455d91fc5886bdd02cb1077226c4bdb728af8080d4"} err="failed to get container status \"463673e3a2b26f40760f34455d91fc5886bdd02cb1077226c4bdb728af8080d4\": rpc error: code = NotFound desc = could not find container \"463673e3a2b26f40760f34455d91fc5886bdd02cb1077226c4bdb728af8080d4\": container with ID starting with 463673e3a2b26f40760f34455d91fc5886bdd02cb1077226c4bdb728af8080d4 not found: ID does not exist" Jul 23 22:29:30.715164 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:30.715105 2575 scope.go:117] "RemoveContainer" containerID="ada54a3608ba03d9a9289a7831487202e7e721f44b7e5d691e3942bfb6b75cd2" Jul 23 22:29:30.719806 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:30.719770 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sbhns" podStartSLOduration=12.719757341 podStartE2EDuration="12.719757341s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 22:29:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:29:30.718639573 +0000 UTC m=+398.438636834" watchObservedRunningTime="2026-07-23 22:29:30.719757341 +0000 UTC m=+398.439754600" Jul 23 22:29:30.720576 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:29:30.720552 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-84kq9\" is forbidden: User \"system:node:ip-10-0-134-206.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-206.ec2.internal' and this object" podUID="6b85193e-e75a-4fd7-af4c-72f6700d0cd7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-84kq9" Jul 23 22:29:30.722304 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:29:30.722283 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-dvkmr\" is forbidden: User \"system:node:ip-10-0-134-206.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-206.ec2.internal' and this object" podUID="47db0138-fa4f-4760-bba7-7e6045d275e5" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dvkmr" Jul 23 22:29:30.723293 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:30.723281 2575 scope.go:117] "RemoveContainer" containerID="ada54a3608ba03d9a9289a7831487202e7e721f44b7e5d691e3942bfb6b75cd2" Jul 23 22:29:30.723535 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:29:30.723517 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ada54a3608ba03d9a9289a7831487202e7e721f44b7e5d691e3942bfb6b75cd2\": container with ID starting with ada54a3608ba03d9a9289a7831487202e7e721f44b7e5d691e3942bfb6b75cd2 not found: ID does not exist" containerID="ada54a3608ba03d9a9289a7831487202e7e721f44b7e5d691e3942bfb6b75cd2" Jul 23 22:29:30.723575 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:30.723543 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ada54a3608ba03d9a9289a7831487202e7e721f44b7e5d691e3942bfb6b75cd2"} err="failed to get container status \"ada54a3608ba03d9a9289a7831487202e7e721f44b7e5d691e3942bfb6b75cd2\": rpc error: code = NotFound desc = could not find container \"ada54a3608ba03d9a9289a7831487202e7e721f44b7e5d691e3942bfb6b75cd2\": container with ID starting with ada54a3608ba03d9a9289a7831487202e7e721f44b7e5d691e3942bfb6b75cd2 not found: ID does not exist" Jul 23 22:29:30.744373 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:30.744318 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tm8td" podStartSLOduration=12.744303321 podStartE2EDuration="12.744303321s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 22:29:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:29:30.74211221 +0000 UTC m=+398.462109470" watchObservedRunningTime="2026-07-23 22:29:30.744303321 +0000 UTC m=+398.464300565" Jul 23 22:29:30.762593 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:30.762556 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jhj4d" podStartSLOduration=12.76254608 podStartE2EDuration="12.76254608s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 22:29:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:29:30.762216105 +0000 UTC m=+398.482213365" watchObservedRunningTime="2026-07-23 22:29:30.76254608 +0000 UTC m=+398.482543351" Jul 23 22:29:30.764238 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:29:30.764217 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-84kq9\" is forbidden: User \"system:node:ip-10-0-134-206.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-206.ec2.internal' and this object" podUID="6b85193e-e75a-4fd7-af4c-72f6700d0cd7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-84kq9" Jul 23 22:29:30.783207 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:30.783169 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fgrbg" podStartSLOduration=2.109045619 podStartE2EDuration="22.783157769s" totalImagesPullingTime="20.67411215s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 22:29:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:29:30.78145975 +0000 UTC m=+398.501457024" watchObservedRunningTime="2026-07-23 22:29:30.783157769 +0000 UTC m=+398.503155028" Jul 23 22:29:30.783443 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:29:30.783419 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-dvkmr\" is forbidden: User \"system:node:ip-10-0-134-206.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-206.ec2.internal' and this object" podUID="47db0138-fa4f-4760-bba7-7e6045d275e5" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dvkmr" Jul 23 22:29:30.813256 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:30.813230 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47db0138-fa4f-4760-bba7-7e6045d275e5" path="/var/lib/kubelet/pods/47db0138-fa4f-4760-bba7-7e6045d275e5/volumes" Jul 23 22:29:30.813666 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:30.813647 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b85193e-e75a-4fd7-af4c-72f6700d0cd7" path="/var/lib/kubelet/pods/6b85193e-e75a-4fd7-af4c-72f6700d0cd7/volumes" Jul 23 22:29:32.293913 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:32.293885 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:29:32.354720 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:32.354690 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:29:32.396588 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:29:32.396553 2575 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-6vjx5_kuadrant-system_57d91d73-8e0a-489c-8090-26d4ee207279_0(b0d30c61b6c72c0a863e385e4151b8b9b27201422b841ba6709667c86b6c2765): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-6vjx5 to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" Jul 23 22:29:32.396702 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:29:32.396603 2575 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-6vjx5_kuadrant-system_57d91d73-8e0a-489c-8090-26d4ee207279_0(b0d30c61b6c72c0a863e385e4151b8b9b27201422b841ba6709667c86b6c2765): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-6vjx5 to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6vjx5" Jul 23 22:29:32.424947 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:32.424922 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:29:32.489173 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:32.489146 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:29:32.718577 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:32.718556 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6vjx5" Jul 23 22:29:32.720919 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:29:32.720894 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-6vjx5\" is forbidden: User \"system:node:ip-10-0-134-206.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-206.ec2.internal' and this object" podUID="57d91d73-8e0a-489c-8090-26d4ee207279" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6vjx5" Jul 23 22:29:32.726521 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:32.726505 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6vjx5" Jul 23 22:29:32.728876 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:29:32.728852 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-6vjx5\" is forbidden: User \"system:node:ip-10-0-134-206.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-206.ec2.internal' and this object" podUID="57d91d73-8e0a-489c-8090-26d4ee207279" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6vjx5" Jul 23 22:29:32.806177 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:29:32.806148 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-6vjx5\" is forbidden: User \"system:node:ip-10-0-134-206.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-206.ec2.internal' and this object" podUID="57d91d73-8e0a-489c-8090-26d4ee207279" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6vjx5" Jul 23 22:29:32.855288 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:32.855265 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/57d91d73-8e0a-489c-8090-26d4ee207279-extensions-socket-volume\") pod \"57d91d73-8e0a-489c-8090-26d4ee207279\" (UID: \"57d91d73-8e0a-489c-8090-26d4ee207279\") " Jul 23 22:29:32.855386 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:32.855311 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cpstt\" (UniqueName: \"kubernetes.io/projected/57d91d73-8e0a-489c-8090-26d4ee207279-kube-api-access-cpstt\") pod \"57d91d73-8e0a-489c-8090-26d4ee207279\" (UID: \"57d91d73-8e0a-489c-8090-26d4ee207279\") " Jul 23 22:29:32.855504 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:32.855482 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57d91d73-8e0a-489c-8090-26d4ee207279-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "57d91d73-8e0a-489c-8090-26d4ee207279" (UID: "57d91d73-8e0a-489c-8090-26d4ee207279"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 22:29:32.857314 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:32.857284 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57d91d73-8e0a-489c-8090-26d4ee207279-kube-api-access-cpstt" (OuterVolumeSpecName: "kube-api-access-cpstt") pod "57d91d73-8e0a-489c-8090-26d4ee207279" (UID: "57d91d73-8e0a-489c-8090-26d4ee207279"). InnerVolumeSpecName "kube-api-access-cpstt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 22:29:32.955987 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:32.955961 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cpstt\" (UniqueName: \"kubernetes.io/projected/57d91d73-8e0a-489c-8090-26d4ee207279-kube-api-access-cpstt\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 22:29:32.955987 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:32.955985 2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/57d91d73-8e0a-489c-8090-26d4ee207279-extensions-socket-volume\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 22:29:33.023931 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:33.023881 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:29:33.124395 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:33.124373 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:29:33.723322 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:33.723297 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6vjx5" Jul 23 22:29:33.725596 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:29:33.725573 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-6vjx5\" is forbidden: User \"system:node:ip-10-0-134-206.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-206.ec2.internal' and this object" podUID="57d91d73-8e0a-489c-8090-26d4ee207279" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6vjx5" Jul 23 22:29:33.730596 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:29:33.730570 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-6vjx5\" is forbidden: User \"system:node:ip-10-0-134-206.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-206.ec2.internal' and this object" podUID="57d91d73-8e0a-489c-8090-26d4ee207279" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6vjx5" Jul 23 22:29:34.816457 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:34.816429 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57d91d73-8e0a-489c-8090-26d4ee207279" path="/var/lib/kubelet/pods/57d91d73-8e0a-489c-8090-26d4ee207279/volumes" Jul 23 22:29:39.829959 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:39.829930 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:29:39.932899 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:39.932871 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:29:40.266538 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:40.266509 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:29:40.361228 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:40.361195 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:29:41.715591 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:41.715558 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sbhns" Jul 23 22:29:41.715946 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:41.715826 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tm8td" Jul 23 22:29:41.716507 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:41.716487 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jhj4d" Jul 23 22:29:41.820760 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:41.820731 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jhj4d"] Jul 23 22:29:41.820937 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:41.820915 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jhj4d" podUID="d7617107-7a32-4ece-b7fa-1a176eb83fb8" containerName="manager" containerID="cri-o://a199e3bf681c0479dbaab12ff030d75ff3af21e2d5b5464eb72e9ab3a1b8cae7" gracePeriod=10 Jul 23 22:29:42.037558 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:42.037524 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2shqm"] Jul 23 22:29:42.039904 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:42.039886 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2shqm" Jul 23 22:29:42.057099 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:42.057068 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2shqm"] Jul 23 22:29:42.075615 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:42.075597 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jhj4d" Jul 23 22:29:42.113518 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:42.113490 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wxchx\" (UniqueName: \"kubernetes.io/projected/d7617107-7a32-4ece-b7fa-1a176eb83fb8-kube-api-access-wxchx\") pod \"d7617107-7a32-4ece-b7fa-1a176eb83fb8\" (UID: \"d7617107-7a32-4ece-b7fa-1a176eb83fb8\") " Jul 23 22:29:42.113645 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:42.113586 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/363fef20-5826-4a06-9d3c-2dfebafcebaa-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-2shqm\" (UID: \"363fef20-5826-4a06-9d3c-2dfebafcebaa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2shqm" Jul 23 22:29:42.113645 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:42.113605 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pr669\" (UniqueName: \"kubernetes.io/projected/363fef20-5826-4a06-9d3c-2dfebafcebaa-kube-api-access-pr669\") pod \"kuadrant-operator-controller-manager-86878c769f-2shqm\" (UID: \"363fef20-5826-4a06-9d3c-2dfebafcebaa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2shqm" Jul 23 22:29:42.115407 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:42.115379 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7617107-7a32-4ece-b7fa-1a176eb83fb8-kube-api-access-wxchx" (OuterVolumeSpecName: "kube-api-access-wxchx") pod "d7617107-7a32-4ece-b7fa-1a176eb83fb8" (UID: "d7617107-7a32-4ece-b7fa-1a176eb83fb8"). InnerVolumeSpecName "kube-api-access-wxchx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 22:29:42.214320 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:42.214299 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d7617107-7a32-4ece-b7fa-1a176eb83fb8-extensions-socket-volume\") pod \"d7617107-7a32-4ece-b7fa-1a176eb83fb8\" (UID: \"d7617107-7a32-4ece-b7fa-1a176eb83fb8\") " Jul 23 22:29:42.214490 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:42.214476 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/363fef20-5826-4a06-9d3c-2dfebafcebaa-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-2shqm\" (UID: \"363fef20-5826-4a06-9d3c-2dfebafcebaa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2shqm" Jul 23 22:29:42.214542 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:42.214504 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pr669\" (UniqueName: \"kubernetes.io/projected/363fef20-5826-4a06-9d3c-2dfebafcebaa-kube-api-access-pr669\") pod \"kuadrant-operator-controller-manager-86878c769f-2shqm\" (UID: \"363fef20-5826-4a06-9d3c-2dfebafcebaa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2shqm" Jul 23 22:29:42.214583 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:42.214567 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wxchx\" (UniqueName: \"kubernetes.io/projected/d7617107-7a32-4ece-b7fa-1a176eb83fb8-kube-api-access-wxchx\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 22:29:42.214632 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:42.214612 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7617107-7a32-4ece-b7fa-1a176eb83fb8-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d7617107-7a32-4ece-b7fa-1a176eb83fb8" (UID: "d7617107-7a32-4ece-b7fa-1a176eb83fb8"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 22:29:42.214802 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:42.214786 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/363fef20-5826-4a06-9d3c-2dfebafcebaa-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-2shqm\" (UID: \"363fef20-5826-4a06-9d3c-2dfebafcebaa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2shqm" Jul 23 22:29:42.223186 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:42.223161 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pr669\" (UniqueName: \"kubernetes.io/projected/363fef20-5826-4a06-9d3c-2dfebafcebaa-kube-api-access-pr669\") pod \"kuadrant-operator-controller-manager-86878c769f-2shqm\" (UID: \"363fef20-5826-4a06-9d3c-2dfebafcebaa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2shqm" Jul 23 22:29:42.315048 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:42.314977 2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d7617107-7a32-4ece-b7fa-1a176eb83fb8-extensions-socket-volume\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 22:29:42.351967 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:42.351947 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2shqm" Jul 23 22:29:42.497168 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:42.497131 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2shqm"] Jul 23 22:29:42.504079 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:29:42.504044 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod363fef20_5826_4a06_9d3c_2dfebafcebaa.slice/crio-e188c3fce909e5337264c02167a79e6e944aa3a4f668b60af5a60876facb0b1c WatchSource:0}: Error finding container e188c3fce909e5337264c02167a79e6e944aa3a4f668b60af5a60876facb0b1c: Status 404 returned error can't find the container with id e188c3fce909e5337264c02167a79e6e944aa3a4f668b60af5a60876facb0b1c Jul 23 22:29:42.771534 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:42.771510 2575 generic.go:356] "Generic (PLEG): container finished" podID="d7617107-7a32-4ece-b7fa-1a176eb83fb8" containerID="a199e3bf681c0479dbaab12ff030d75ff3af21e2d5b5464eb72e9ab3a1b8cae7" exitCode=0 Jul 23 22:29:42.771926 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:42.771561 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jhj4d" Jul 23 22:29:42.771926 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:42.771581 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jhj4d" event={"ID":"d7617107-7a32-4ece-b7fa-1a176eb83fb8","Type":"ContainerDied","Data":"a199e3bf681c0479dbaab12ff030d75ff3af21e2d5b5464eb72e9ab3a1b8cae7"} Jul 23 22:29:42.771926 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:42.771629 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jhj4d" event={"ID":"d7617107-7a32-4ece-b7fa-1a176eb83fb8","Type":"ContainerDied","Data":"c54a645883bfac2d6df6b9bbedb296465ea9ee2bb4296f126e83410962ff9f2f"} Jul 23 22:29:42.771926 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:42.771661 2575 scope.go:117] "RemoveContainer" containerID="a199e3bf681c0479dbaab12ff030d75ff3af21e2d5b5464eb72e9ab3a1b8cae7" Jul 23 22:29:42.773271 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:42.773240 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2shqm" event={"ID":"363fef20-5826-4a06-9d3c-2dfebafcebaa","Type":"ContainerStarted","Data":"14177d4300d5d7a435fe5d5ad690d6040ab95fc280022f4e72c3f42d22b3eb3c"} Jul 23 22:29:42.773392 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:42.773296 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2shqm" event={"ID":"363fef20-5826-4a06-9d3c-2dfebafcebaa","Type":"ContainerStarted","Data":"e188c3fce909e5337264c02167a79e6e944aa3a4f668b60af5a60876facb0b1c"} Jul 23 22:29:42.773392 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:42.773330 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2shqm" Jul 23 22:29:42.780763 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:42.780741 2575 scope.go:117] "RemoveContainer" containerID="a199e3bf681c0479dbaab12ff030d75ff3af21e2d5b5464eb72e9ab3a1b8cae7" Jul 23 22:29:42.781035 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:29:42.781003 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a199e3bf681c0479dbaab12ff030d75ff3af21e2d5b5464eb72e9ab3a1b8cae7\": container with ID starting with a199e3bf681c0479dbaab12ff030d75ff3af21e2d5b5464eb72e9ab3a1b8cae7 not found: ID does not exist" containerID="a199e3bf681c0479dbaab12ff030d75ff3af21e2d5b5464eb72e9ab3a1b8cae7" Jul 23 22:29:42.781082 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:42.781053 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a199e3bf681c0479dbaab12ff030d75ff3af21e2d5b5464eb72e9ab3a1b8cae7"} err="failed to get container status \"a199e3bf681c0479dbaab12ff030d75ff3af21e2d5b5464eb72e9ab3a1b8cae7\": rpc error: code = NotFound desc = could not find container \"a199e3bf681c0479dbaab12ff030d75ff3af21e2d5b5464eb72e9ab3a1b8cae7\": container with ID starting with a199e3bf681c0479dbaab12ff030d75ff3af21e2d5b5464eb72e9ab3a1b8cae7 not found: ID does not exist" Jul 23 22:29:42.808008 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:42.807964 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2shqm" podStartSLOduration=0.807952492 podStartE2EDuration="807.952492ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 22:29:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:29:42.804857057 +0000 UTC m=+410.524854330" watchObservedRunningTime="2026-07-23 22:29:42.807952492 +0000 UTC m=+410.527949752" Jul 23 22:29:42.826990 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:42.826971 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jhj4d"] Jul 23 22:29:42.829855 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:42.829836 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jhj4d"] Jul 23 22:29:42.952979 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:42.952952 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-58f575999-6hpvx"] Jul 23 22:29:43.083590 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:43.083520 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:29:43.180104 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:43.180080 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:29:43.276985 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:43.276959 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:29:43.610929 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:43.610898 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:29:43.714259 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:43.714232 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:29:44.813332 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:44.813299 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7617107-7a32-4ece-b7fa-1a176eb83fb8" path="/var/lib/kubelet/pods/d7617107-7a32-4ece-b7fa-1a176eb83fb8/volumes" Jul 23 22:29:45.164330 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:45.164255 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:29:45.263483 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:45.263457 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:29:53.782689 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:53.782664 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2shqm" Jul 23 22:29:53.843173 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:53.843129 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tm8td"] Jul 23 22:29:53.843579 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:53.843530 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tm8td" podUID="4417103a-5e93-4347-ba0d-25a6f1010f88" containerName="manager" containerID="cri-o://49627f8a2777f2f08ce61d7c2af479952033bbfb0b65119f2bb4c3af10f03afd" gracePeriod=10 Jul 23 22:29:54.840988 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:54.840961 2575 generic.go:356] "Generic (PLEG): container finished" podID="4417103a-5e93-4347-ba0d-25a6f1010f88" containerID="49627f8a2777f2f08ce61d7c2af479952033bbfb0b65119f2bb4c3af10f03afd" exitCode=0 Jul 23 22:29:54.841295 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:54.841001 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tm8td" event={"ID":"4417103a-5e93-4347-ba0d-25a6f1010f88","Type":"ContainerDied","Data":"49627f8a2777f2f08ce61d7c2af479952033bbfb0b65119f2bb4c3af10f03afd"} Jul 23 22:29:54.841295 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:54.841046 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tm8td" event={"ID":"4417103a-5e93-4347-ba0d-25a6f1010f88","Type":"ContainerDied","Data":"162c50f84010f32159d682bd7e4e76e75fdeb88d749e5409c8080a37b03f3164"} Jul 23 22:29:54.841295 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:54.841063 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="162c50f84010f32159d682bd7e4e76e75fdeb88d749e5409c8080a37b03f3164" Jul 23 22:29:54.981868 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:54.981804 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tm8td" Jul 23 22:29:55.005206 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:55.005181 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9ndcc\" (UniqueName: \"kubernetes.io/projected/4417103a-5e93-4347-ba0d-25a6f1010f88-kube-api-access-9ndcc\") pod \"4417103a-5e93-4347-ba0d-25a6f1010f88\" (UID: \"4417103a-5e93-4347-ba0d-25a6f1010f88\") " Jul 23 22:29:55.005336 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:55.005218 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4417103a-5e93-4347-ba0d-25a6f1010f88-extensions-socket-volume\") pod \"4417103a-5e93-4347-ba0d-25a6f1010f88\" (UID: \"4417103a-5e93-4347-ba0d-25a6f1010f88\") " Jul 23 22:29:55.005669 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:55.005638 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4417103a-5e93-4347-ba0d-25a6f1010f88-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "4417103a-5e93-4347-ba0d-25a6f1010f88" (UID: "4417103a-5e93-4347-ba0d-25a6f1010f88"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 22:29:55.007543 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:55.007516 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4417103a-5e93-4347-ba0d-25a6f1010f88-kube-api-access-9ndcc" (OuterVolumeSpecName: "kube-api-access-9ndcc") pod "4417103a-5e93-4347-ba0d-25a6f1010f88" (UID: "4417103a-5e93-4347-ba0d-25a6f1010f88"). InnerVolumeSpecName "kube-api-access-9ndcc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 22:29:55.106234 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:55.106207 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9ndcc\" (UniqueName: \"kubernetes.io/projected/4417103a-5e93-4347-ba0d-25a6f1010f88-kube-api-access-9ndcc\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 22:29:55.106234 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:55.106228 2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4417103a-5e93-4347-ba0d-25a6f1010f88-extensions-socket-volume\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 22:29:55.847003 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:55.846972 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tm8td" Jul 23 22:29:55.869650 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:55.869621 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tm8td"] Jul 23 22:29:55.874572 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:55.874538 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-tm8td"] Jul 23 22:29:56.807595 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:56.807560 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4417103a-5e93-4347-ba0d-25a6f1010f88" path="/var/lib/kubelet/pods/4417103a-5e93-4347-ba0d-25a6f1010f88/volumes" Jul 23 22:29:58.355492 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:58.355457 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:29:58.487976 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:58.487945 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:29:59.710794 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:29:59.710765 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:30:07.972811 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:07.972775 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-58f575999-6hpvx" podUID="a9ff9839-b9c0-463c-8969-906a1124b70d" containerName="console" containerID="cri-o://2bd3923d565905e388d469f4777c6f115630d022f910e37295e33d27f331bf37" gracePeriod=15 Jul 23 22:30:08.221840 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:08.221817 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58f575999-6hpvx" Jul 23 22:30:08.300101 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:08.300045 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9ff9839-b9c0-463c-8969-906a1124b70d-trusted-ca-bundle\") pod \"a9ff9839-b9c0-463c-8969-906a1124b70d\" (UID: \"a9ff9839-b9c0-463c-8969-906a1124b70d\") " Jul 23 22:30:08.300101 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:08.300080 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a9ff9839-b9c0-463c-8969-906a1124b70d-console-serving-cert\") pod \"a9ff9839-b9c0-463c-8969-906a1124b70d\" (UID: \"a9ff9839-b9c0-463c-8969-906a1124b70d\") " Jul 23 22:30:08.300302 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:08.300105 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a9ff9839-b9c0-463c-8969-906a1124b70d-console-oauth-config\") pod \"a9ff9839-b9c0-463c-8969-906a1124b70d\" (UID: \"a9ff9839-b9c0-463c-8969-906a1124b70d\") " Jul 23 22:30:08.300302 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:08.300279 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n2dbr\" (UniqueName: \"kubernetes.io/projected/a9ff9839-b9c0-463c-8969-906a1124b70d-kube-api-access-n2dbr\") pod \"a9ff9839-b9c0-463c-8969-906a1124b70d\" (UID: \"a9ff9839-b9c0-463c-8969-906a1124b70d\") " Jul 23 22:30:08.300420 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:08.300331 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a9ff9839-b9c0-463c-8969-906a1124b70d-console-config\") pod \"a9ff9839-b9c0-463c-8969-906a1124b70d\" (UID: \"a9ff9839-b9c0-463c-8969-906a1124b70d\") " Jul 23 22:30:08.300420 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:08.300375 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a9ff9839-b9c0-463c-8969-906a1124b70d-service-ca\") pod \"a9ff9839-b9c0-463c-8969-906a1124b70d\" (UID: \"a9ff9839-b9c0-463c-8969-906a1124b70d\") " Jul 23 22:30:08.300420 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:08.300406 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a9ff9839-b9c0-463c-8969-906a1124b70d-oauth-serving-cert\") pod \"a9ff9839-b9c0-463c-8969-906a1124b70d\" (UID: \"a9ff9839-b9c0-463c-8969-906a1124b70d\") " Jul 23 22:30:08.300575 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:08.300494 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9ff9839-b9c0-463c-8969-906a1124b70d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a9ff9839-b9c0-463c-8969-906a1124b70d" (UID: "a9ff9839-b9c0-463c-8969-906a1124b70d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 22:30:08.300681 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:08.300662 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9ff9839-b9c0-463c-8969-906a1124b70d-trusted-ca-bundle\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 22:30:08.300764 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:08.300738 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9ff9839-b9c0-463c-8969-906a1124b70d-service-ca" (OuterVolumeSpecName: "service-ca") pod "a9ff9839-b9c0-463c-8969-906a1124b70d" (UID: "a9ff9839-b9c0-463c-8969-906a1124b70d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 22:30:08.300825 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:08.300745 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9ff9839-b9c0-463c-8969-906a1124b70d-console-config" (OuterVolumeSpecName: "console-config") pod "a9ff9839-b9c0-463c-8969-906a1124b70d" (UID: "a9ff9839-b9c0-463c-8969-906a1124b70d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 22:30:08.300882 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:08.300853 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9ff9839-b9c0-463c-8969-906a1124b70d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a9ff9839-b9c0-463c-8969-906a1124b70d" (UID: "a9ff9839-b9c0-463c-8969-906a1124b70d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 22:30:08.302121 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:08.302099 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9ff9839-b9c0-463c-8969-906a1124b70d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a9ff9839-b9c0-463c-8969-906a1124b70d" (UID: "a9ff9839-b9c0-463c-8969-906a1124b70d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 22:30:08.302532 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:08.302515 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9ff9839-b9c0-463c-8969-906a1124b70d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a9ff9839-b9c0-463c-8969-906a1124b70d" (UID: "a9ff9839-b9c0-463c-8969-906a1124b70d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 22:30:08.302584 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:08.302550 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9ff9839-b9c0-463c-8969-906a1124b70d-kube-api-access-n2dbr" (OuterVolumeSpecName: "kube-api-access-n2dbr") pod "a9ff9839-b9c0-463c-8969-906a1124b70d" (UID: "a9ff9839-b9c0-463c-8969-906a1124b70d"). InnerVolumeSpecName "kube-api-access-n2dbr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 22:30:08.401520 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:08.401497 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a9ff9839-b9c0-463c-8969-906a1124b70d-console-serving-cert\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 22:30:08.401602 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:08.401520 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a9ff9839-b9c0-463c-8969-906a1124b70d-console-oauth-config\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 22:30:08.401602 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:08.401533 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n2dbr\" (UniqueName: \"kubernetes.io/projected/a9ff9839-b9c0-463c-8969-906a1124b70d-kube-api-access-n2dbr\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 22:30:08.401602 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:08.401543 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a9ff9839-b9c0-463c-8969-906a1124b70d-console-config\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 22:30:08.401602 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:08.401551 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a9ff9839-b9c0-463c-8969-906a1124b70d-service-ca\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 22:30:08.401602 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:08.401561 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a9ff9839-b9c0-463c-8969-906a1124b70d-oauth-serving-cert\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 22:30:08.910801 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:08.910779 2575 generic.go:356] "Generic (PLEG): container finished" podID="a9ff9839-b9c0-463c-8969-906a1124b70d" containerID="2bd3923d565905e388d469f4777c6f115630d022f910e37295e33d27f331bf37" exitCode=0 Jul 23 22:30:08.910916 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:08.910826 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58f575999-6hpvx" Jul 23 22:30:08.910916 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:08.910854 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58f575999-6hpvx" event={"ID":"a9ff9839-b9c0-463c-8969-906a1124b70d","Type":"ContainerDied","Data":"2bd3923d565905e388d469f4777c6f115630d022f910e37295e33d27f331bf37"} Jul 23 22:30:08.910916 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:08.910887 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58f575999-6hpvx" event={"ID":"a9ff9839-b9c0-463c-8969-906a1124b70d","Type":"ContainerDied","Data":"cd49e3e189198508ff952add6e575fd4b99ddf470b45563f7d925a809fc73734"} Jul 23 22:30:08.910916 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:08.910906 2575 scope.go:117] "RemoveContainer" containerID="2bd3923d565905e388d469f4777c6f115630d022f910e37295e33d27f331bf37" Jul 23 22:30:08.919342 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:08.919326 2575 scope.go:117] "RemoveContainer" containerID="2bd3923d565905e388d469f4777c6f115630d022f910e37295e33d27f331bf37" Jul 23 22:30:08.919565 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:30:08.919547 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2bd3923d565905e388d469f4777c6f115630d022f910e37295e33d27f331bf37\": container with ID starting with 2bd3923d565905e388d469f4777c6f115630d022f910e37295e33d27f331bf37 not found: ID does not exist" containerID="2bd3923d565905e388d469f4777c6f115630d022f910e37295e33d27f331bf37" Jul 23 22:30:08.919608 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:08.919573 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2bd3923d565905e388d469f4777c6f115630d022f910e37295e33d27f331bf37"} err="failed to get container status \"2bd3923d565905e388d469f4777c6f115630d022f910e37295e33d27f331bf37\": rpc error: code = NotFound desc = could not find container \"2bd3923d565905e388d469f4777c6f115630d022f910e37295e33d27f331bf37\": container with ID starting with 2bd3923d565905e388d469f4777c6f115630d022f910e37295e33d27f331bf37 not found: ID does not exist" Jul 23 22:30:08.927767 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:08.927746 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-58f575999-6hpvx"] Jul 23 22:30:08.931342 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:08.931312 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-58f575999-6hpvx"] Jul 23 22:30:10.807611 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:10.807573 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9ff9839-b9c0-463c-8969-906a1124b70d" path="/var/lib/kubelet/pods/a9ff9839-b9c0-463c-8969-906a1124b70d/volumes" Jul 23 22:30:12.102018 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:12.101986 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:30:12.106263 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:12.106232 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-pcvgx"] Jul 23 22:30:12.106640 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:12.106624 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9ff9839-b9c0-463c-8969-906a1124b70d" containerName="console" Jul 23 22:30:12.106735 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:12.106643 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9ff9839-b9c0-463c-8969-906a1124b70d" containerName="console" Jul 23 22:30:12.106735 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:12.106687 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4417103a-5e93-4347-ba0d-25a6f1010f88" containerName="manager" Jul 23 22:30:12.106735 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:12.106697 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="4417103a-5e93-4347-ba0d-25a6f1010f88" containerName="manager" Jul 23 22:30:12.106735 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:12.106708 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7617107-7a32-4ece-b7fa-1a176eb83fb8" containerName="manager" Jul 23 22:30:12.106735 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:12.106716 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7617107-7a32-4ece-b7fa-1a176eb83fb8" containerName="manager" Jul 23 22:30:12.106976 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:12.106793 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7617107-7a32-4ece-b7fa-1a176eb83fb8" containerName="manager" Jul 23 22:30:12.106976 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:12.106805 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9ff9839-b9c0-463c-8969-906a1124b70d" containerName="console" Jul 23 22:30:12.106976 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:12.106816 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="4417103a-5e93-4347-ba0d-25a6f1010f88" containerName="manager" Jul 23 22:30:12.111297 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:12.111277 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-pcvgx" Jul 23 22:30:12.114276 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:12.114259 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 23 22:30:12.120220 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:12.120174 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-pcvgx"] Jul 23 22:30:12.200303 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:12.200272 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-pcvgx"] Jul 23 22:30:12.204651 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:12.204623 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:30:12.229705 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:12.229679 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qr982\" (UniqueName: \"kubernetes.io/projected/6364c9d0-5a44-43ad-a031-dfc3a0861a0e-kube-api-access-qr982\") pod \"limitador-limitador-64c94fd64f-pcvgx\" (UID: \"6364c9d0-5a44-43ad-a031-dfc3a0861a0e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-pcvgx" Jul 23 22:30:12.229805 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:12.229725 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6364c9d0-5a44-43ad-a031-dfc3a0861a0e-config-file\") pod \"limitador-limitador-64c94fd64f-pcvgx\" (UID: \"6364c9d0-5a44-43ad-a031-dfc3a0861a0e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-pcvgx" Jul 23 22:30:12.259922 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:12.259900 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:30:12.330230 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:12.330207 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6364c9d0-5a44-43ad-a031-dfc3a0861a0e-config-file\") pod \"limitador-limitador-64c94fd64f-pcvgx\" (UID: \"6364c9d0-5a44-43ad-a031-dfc3a0861a0e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-pcvgx" Jul 23 22:30:12.330339 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:12.330276 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qr982\" (UniqueName: \"kubernetes.io/projected/6364c9d0-5a44-43ad-a031-dfc3a0861a0e-kube-api-access-qr982\") pod \"limitador-limitador-64c94fd64f-pcvgx\" (UID: \"6364c9d0-5a44-43ad-a031-dfc3a0861a0e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-pcvgx" Jul 23 22:30:12.330823 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:12.330800 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6364c9d0-5a44-43ad-a031-dfc3a0861a0e-config-file\") pod \"limitador-limitador-64c94fd64f-pcvgx\" (UID: \"6364c9d0-5a44-43ad-a031-dfc3a0861a0e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-pcvgx" Jul 23 22:30:12.337901 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:12.337876 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qr982\" (UniqueName: \"kubernetes.io/projected/6364c9d0-5a44-43ad-a031-dfc3a0861a0e-kube-api-access-qr982\") pod \"limitador-limitador-64c94fd64f-pcvgx\" (UID: \"6364c9d0-5a44-43ad-a031-dfc3a0861a0e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-pcvgx" Jul 23 22:30:12.422070 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:12.421998 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-pcvgx" Jul 23 22:30:12.554939 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:12.554913 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-pcvgx"] Jul 23 22:30:12.557044 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:30:12.556991 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6364c9d0_5a44_43ad_a031_dfc3a0861a0e.slice/crio-bb9520c46afda018823d7ac84ef63cd7d8a2012a5fe1e9b0aab71a976087f3ad WatchSource:0}: Error finding container bb9520c46afda018823d7ac84ef63cd7d8a2012a5fe1e9b0aab71a976087f3ad: Status 404 returned error can't find the container with id bb9520c46afda018823d7ac84ef63cd7d8a2012a5fe1e9b0aab71a976087f3ad Jul 23 22:30:12.922651 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:12.922622 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-c8pcv"] Jul 23 22:30:12.927211 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:12.927187 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-c8pcv" Jul 23 22:30:12.929961 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:12.929938 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-hqcmc\"" Jul 23 22:30:12.935535 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:12.935511 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-c8pcv"] Jul 23 22:30:12.939780 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:12.939758 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-pcvgx" event={"ID":"6364c9d0-5a44-43ad-a031-dfc3a0861a0e","Type":"ContainerStarted","Data":"bb9520c46afda018823d7ac84ef63cd7d8a2012a5fe1e9b0aab71a976087f3ad"} Jul 23 22:30:12.955484 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:12.955464 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:30:13.034743 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:13.034718 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhswr\" (UniqueName: \"kubernetes.io/projected/465d9b56-c1b7-4330-88d2-cc56abb9ab26-kube-api-access-qhswr\") pod \"authorino-58cd955675-c8pcv\" (UID: \"465d9b56-c1b7-4330-88d2-cc56abb9ab26\") " pod="kuadrant-system/authorino-58cd955675-c8pcv" Jul 23 22:30:13.055725 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:13.055705 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:30:13.135341 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:13.135314 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhswr\" (UniqueName: \"kubernetes.io/projected/465d9b56-c1b7-4330-88d2-cc56abb9ab26-kube-api-access-qhswr\") pod \"authorino-58cd955675-c8pcv\" (UID: \"465d9b56-c1b7-4330-88d2-cc56abb9ab26\") " pod="kuadrant-system/authorino-58cd955675-c8pcv" Jul 23 22:30:13.144457 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:13.144422 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhswr\" (UniqueName: \"kubernetes.io/projected/465d9b56-c1b7-4330-88d2-cc56abb9ab26-kube-api-access-qhswr\") pod \"authorino-58cd955675-c8pcv\" (UID: \"465d9b56-c1b7-4330-88d2-cc56abb9ab26\") " pod="kuadrant-system/authorino-58cd955675-c8pcv" Jul 23 22:30:13.238823 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:13.238304 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-c8pcv" Jul 23 22:30:13.271011 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:13.270984 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-t22l7"] Jul 23 22:30:13.278197 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:13.278178 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-t22l7" Jul 23 22:30:13.282955 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:13.282493 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-t22l7"] Jul 23 22:30:13.338371 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:13.337792 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9fpv\" (UniqueName: \"kubernetes.io/projected/a867c45c-48e6-4abe-95f9-922f9b507d15-kube-api-access-p9fpv\") pod \"authorino-75d556bd77-t22l7\" (UID: \"a867c45c-48e6-4abe-95f9-922f9b507d15\") " pod="kuadrant-system/authorino-75d556bd77-t22l7" Jul 23 22:30:13.421141 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:13.420934 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-c8pcv"] Jul 23 22:30:13.423587 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:30:13.423281 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod465d9b56_c1b7_4330_88d2_cc56abb9ab26.slice/crio-3d63321aa1e8782229482dee55ea9c3dd3dfb7fb917524757a0eba103da58c7c WatchSource:0}: Error finding container 3d63321aa1e8782229482dee55ea9c3dd3dfb7fb917524757a0eba103da58c7c: Status 404 returned error can't find the container with id 3d63321aa1e8782229482dee55ea9c3dd3dfb7fb917524757a0eba103da58c7c Jul 23 22:30:13.438695 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:13.438663 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9fpv\" (UniqueName: \"kubernetes.io/projected/a867c45c-48e6-4abe-95f9-922f9b507d15-kube-api-access-p9fpv\") pod \"authorino-75d556bd77-t22l7\" (UID: \"a867c45c-48e6-4abe-95f9-922f9b507d15\") " pod="kuadrant-system/authorino-75d556bd77-t22l7" Jul 23 22:30:13.449622 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:13.449565 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9fpv\" (UniqueName: \"kubernetes.io/projected/a867c45c-48e6-4abe-95f9-922f9b507d15-kube-api-access-p9fpv\") pod \"authorino-75d556bd77-t22l7\" (UID: \"a867c45c-48e6-4abe-95f9-922f9b507d15\") " pod="kuadrant-system/authorino-75d556bd77-t22l7" Jul 23 22:30:13.597497 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:13.597427 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-t22l7" Jul 23 22:30:13.752686 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:13.752659 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-t22l7"] Jul 23 22:30:13.755326 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:30:13.755298 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda867c45c_48e6_4abe_95f9_922f9b507d15.slice/crio-40fe71125500b5f0bb8ba436c97e40d9a2ab93e03f104196b03b0927ac39de9f WatchSource:0}: Error finding container 40fe71125500b5f0bb8ba436c97e40d9a2ab93e03f104196b03b0927ac39de9f: Status 404 returned error can't find the container with id 40fe71125500b5f0bb8ba436c97e40d9a2ab93e03f104196b03b0927ac39de9f Jul 23 22:30:13.948383 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:13.948343 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-c8pcv" event={"ID":"465d9b56-c1b7-4330-88d2-cc56abb9ab26","Type":"ContainerStarted","Data":"3d63321aa1e8782229482dee55ea9c3dd3dfb7fb917524757a0eba103da58c7c"} Jul 23 22:30:13.949670 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:13.949637 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-t22l7" event={"ID":"a867c45c-48e6-4abe-95f9-922f9b507d15","Type":"ContainerStarted","Data":"40fe71125500b5f0bb8ba436c97e40d9a2ab93e03f104196b03b0927ac39de9f"} Jul 23 22:30:16.659767 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:16.659680 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:30:17.976942 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:17.976906 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-pcvgx" event={"ID":"6364c9d0-5a44-43ad-a031-dfc3a0861a0e","Type":"ContainerStarted","Data":"35f2cb438c01bba48b0c456fb647715766a3013a2d426ac4b2001b1733c820a4"} Jul 23 22:30:17.977359 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:17.977068 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-pcvgx" Jul 23 22:30:17.978442 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:17.978420 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-c8pcv" event={"ID":"465d9b56-c1b7-4330-88d2-cc56abb9ab26","Type":"ContainerStarted","Data":"08756b8ae9b3dabfa0d3fbff3d42540e679356477c24f7594577224924cc5e70"} Jul 23 22:30:17.979763 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:17.979739 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-t22l7" event={"ID":"a867c45c-48e6-4abe-95f9-922f9b507d15","Type":"ContainerStarted","Data":"688bfbd0ba2e11b233a82e8dc9b18b0dd42b705073e6bb7051dc1e68d35696f6"} Jul 23 22:30:17.995182 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:17.995140 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-pcvgx" podStartSLOduration=1.3207455160000001 podStartE2EDuration="5.99512824s" totalImagesPullingTime="4.674382724s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 22:30:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:30:17.993166506 +0000 UTC m=+445.713163783" watchObservedRunningTime="2026-07-23 22:30:17.99512824 +0000 UTC m=+445.715125498" Jul 23 22:30:18.009631 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:18.009587 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-c8pcv" podStartSLOduration=2.161763009 podStartE2EDuration="6.009576116s" totalImagesPullingTime="3.847813107s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 22:30:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:30:18.007790314 +0000 UTC m=+445.727787601" watchObservedRunningTime="2026-07-23 22:30:18.009576116 +0000 UTC m=+445.729573405" Jul 23 22:30:18.023536 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:18.023490 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-t22l7" podStartSLOduration=1.497125801 podStartE2EDuration="5.023473913s" totalImagesPullingTime="3.526348112s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 22:30:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:30:18.022344018 +0000 UTC m=+445.742341278" watchObservedRunningTime="2026-07-23 22:30:18.023473913 +0000 UTC m=+445.743471175" Jul 23 22:30:18.054989 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:18.054963 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-c8pcv"] Jul 23 22:30:19.990616 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:19.990570 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-c8pcv" podUID="465d9b56-c1b7-4330-88d2-cc56abb9ab26" containerName="authorino" containerID="cri-o://08756b8ae9b3dabfa0d3fbff3d42540e679356477c24f7594577224924cc5e70" gracePeriod=30 Jul 23 22:30:20.233231 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:20.233208 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-c8pcv" Jul 23 22:30:20.295967 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:20.295913 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qhswr\" (UniqueName: \"kubernetes.io/projected/465d9b56-c1b7-4330-88d2-cc56abb9ab26-kube-api-access-qhswr\") pod \"465d9b56-c1b7-4330-88d2-cc56abb9ab26\" (UID: \"465d9b56-c1b7-4330-88d2-cc56abb9ab26\") " Jul 23 22:30:20.297814 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:20.297787 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/465d9b56-c1b7-4330-88d2-cc56abb9ab26-kube-api-access-qhswr" (OuterVolumeSpecName: "kube-api-access-qhswr") pod "465d9b56-c1b7-4330-88d2-cc56abb9ab26" (UID: "465d9b56-c1b7-4330-88d2-cc56abb9ab26"). InnerVolumeSpecName "kube-api-access-qhswr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 22:30:20.397312 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:20.397287 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qhswr\" (UniqueName: \"kubernetes.io/projected/465d9b56-c1b7-4330-88d2-cc56abb9ab26-kube-api-access-qhswr\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 22:30:20.996174 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:20.996135 2575 generic.go:356] "Generic (PLEG): container finished" podID="465d9b56-c1b7-4330-88d2-cc56abb9ab26" containerID="08756b8ae9b3dabfa0d3fbff3d42540e679356477c24f7594577224924cc5e70" exitCode=0 Jul 23 22:30:20.996580 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:20.996180 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-c8pcv" Jul 23 22:30:20.996580 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:20.996187 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-c8pcv" event={"ID":"465d9b56-c1b7-4330-88d2-cc56abb9ab26","Type":"ContainerDied","Data":"08756b8ae9b3dabfa0d3fbff3d42540e679356477c24f7594577224924cc5e70"} Jul 23 22:30:20.996580 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:20.996293 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-c8pcv" event={"ID":"465d9b56-c1b7-4330-88d2-cc56abb9ab26","Type":"ContainerDied","Data":"3d63321aa1e8782229482dee55ea9c3dd3dfb7fb917524757a0eba103da58c7c"} Jul 23 22:30:20.996580 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:20.996312 2575 scope.go:117] "RemoveContainer" containerID="08756b8ae9b3dabfa0d3fbff3d42540e679356477c24f7594577224924cc5e70" Jul 23 22:30:21.005238 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:21.005221 2575 scope.go:117] "RemoveContainer" containerID="08756b8ae9b3dabfa0d3fbff3d42540e679356477c24f7594577224924cc5e70" Jul 23 22:30:21.005495 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:30:21.005475 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08756b8ae9b3dabfa0d3fbff3d42540e679356477c24f7594577224924cc5e70\": container with ID starting with 08756b8ae9b3dabfa0d3fbff3d42540e679356477c24f7594577224924cc5e70 not found: ID does not exist" containerID="08756b8ae9b3dabfa0d3fbff3d42540e679356477c24f7594577224924cc5e70" Jul 23 22:30:21.005540 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:21.005503 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08756b8ae9b3dabfa0d3fbff3d42540e679356477c24f7594577224924cc5e70"} err="failed to get container status \"08756b8ae9b3dabfa0d3fbff3d42540e679356477c24f7594577224924cc5e70\": rpc error: code = NotFound desc = could not find container \"08756b8ae9b3dabfa0d3fbff3d42540e679356477c24f7594577224924cc5e70\": container with ID starting with 08756b8ae9b3dabfa0d3fbff3d42540e679356477c24f7594577224924cc5e70 not found: ID does not exist" Jul 23 22:30:21.015238 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:21.015219 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-c8pcv"] Jul 23 22:30:21.019892 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:21.019875 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-c8pcv"] Jul 23 22:30:22.807786 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:22.807757 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="465d9b56-c1b7-4330-88d2-cc56abb9ab26" path="/var/lib/kubelet/pods/465d9b56-c1b7-4330-88d2-cc56abb9ab26/volumes" Jul 23 22:30:27.098485 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:27.098451 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-pcvgx"] Jul 23 22:30:27.098978 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:27.098643 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-pcvgx" podUID="6364c9d0-5a44-43ad-a031-dfc3a0861a0e" containerName="limitador" containerID="cri-o://35f2cb438c01bba48b0c456fb647715766a3013a2d426ac4b2001b1733c820a4" gracePeriod=30 Jul 23 22:30:27.099317 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:27.099205 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-pcvgx" Jul 23 22:30:27.637099 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:27.637076 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-pcvgx" Jul 23 22:30:27.750105 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:27.750082 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6364c9d0-5a44-43ad-a031-dfc3a0861a0e-config-file\") pod \"6364c9d0-5a44-43ad-a031-dfc3a0861a0e\" (UID: \"6364c9d0-5a44-43ad-a031-dfc3a0861a0e\") " Jul 23 22:30:27.750215 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:27.750141 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qr982\" (UniqueName: \"kubernetes.io/projected/6364c9d0-5a44-43ad-a031-dfc3a0861a0e-kube-api-access-qr982\") pod \"6364c9d0-5a44-43ad-a031-dfc3a0861a0e\" (UID: \"6364c9d0-5a44-43ad-a031-dfc3a0861a0e\") " Jul 23 22:30:27.750466 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:27.750443 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6364c9d0-5a44-43ad-a031-dfc3a0861a0e-config-file" (OuterVolumeSpecName: "config-file") pod "6364c9d0-5a44-43ad-a031-dfc3a0861a0e" (UID: "6364c9d0-5a44-43ad-a031-dfc3a0861a0e"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 22:30:27.752015 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:27.751999 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6364c9d0-5a44-43ad-a031-dfc3a0861a0e-kube-api-access-qr982" (OuterVolumeSpecName: "kube-api-access-qr982") pod "6364c9d0-5a44-43ad-a031-dfc3a0861a0e" (UID: "6364c9d0-5a44-43ad-a031-dfc3a0861a0e"). InnerVolumeSpecName "kube-api-access-qr982". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 22:30:27.851641 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:27.851620 2575 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6364c9d0-5a44-43ad-a031-dfc3a0861a0e-config-file\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 22:30:27.851641 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:27.851642 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qr982\" (UniqueName: \"kubernetes.io/projected/6364c9d0-5a44-43ad-a031-dfc3a0861a0e-kube-api-access-qr982\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 22:30:28.033852 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:28.033795 2575 generic.go:356] "Generic (PLEG): container finished" podID="6364c9d0-5a44-43ad-a031-dfc3a0861a0e" containerID="35f2cb438c01bba48b0c456fb647715766a3013a2d426ac4b2001b1733c820a4" exitCode=0 Jul 23 22:30:28.033852 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:28.033835 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-pcvgx" Jul 23 22:30:28.034002 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:28.033861 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-pcvgx" event={"ID":"6364c9d0-5a44-43ad-a031-dfc3a0861a0e","Type":"ContainerDied","Data":"35f2cb438c01bba48b0c456fb647715766a3013a2d426ac4b2001b1733c820a4"} Jul 23 22:30:28.034002 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:28.033903 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-pcvgx" event={"ID":"6364c9d0-5a44-43ad-a031-dfc3a0861a0e","Type":"ContainerDied","Data":"bb9520c46afda018823d7ac84ef63cd7d8a2012a5fe1e9b0aab71a976087f3ad"} Jul 23 22:30:28.034002 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:28.033925 2575 scope.go:117] "RemoveContainer" containerID="35f2cb438c01bba48b0c456fb647715766a3013a2d426ac4b2001b1733c820a4" Jul 23 22:30:28.042162 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:28.042143 2575 scope.go:117] "RemoveContainer" containerID="35f2cb438c01bba48b0c456fb647715766a3013a2d426ac4b2001b1733c820a4" Jul 23 22:30:28.042408 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:30:28.042390 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35f2cb438c01bba48b0c456fb647715766a3013a2d426ac4b2001b1733c820a4\": container with ID starting with 35f2cb438c01bba48b0c456fb647715766a3013a2d426ac4b2001b1733c820a4 not found: ID does not exist" containerID="35f2cb438c01bba48b0c456fb647715766a3013a2d426ac4b2001b1733c820a4" Jul 23 22:30:28.042463 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:28.042420 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35f2cb438c01bba48b0c456fb647715766a3013a2d426ac4b2001b1733c820a4"} err="failed to get container status \"35f2cb438c01bba48b0c456fb647715766a3013a2d426ac4b2001b1733c820a4\": rpc error: code = NotFound desc = could not find container \"35f2cb438c01bba48b0c456fb647715766a3013a2d426ac4b2001b1733c820a4\": container with ID starting with 35f2cb438c01bba48b0c456fb647715766a3013a2d426ac4b2001b1733c820a4 not found: ID does not exist" Jul 23 22:30:28.055056 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:28.055000 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-pcvgx"] Jul 23 22:30:28.058574 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:28.058555 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-pcvgx"] Jul 23 22:30:28.807169 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:28.807138 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6364c9d0-5a44-43ad-a031-dfc3a0861a0e" path="/var/lib/kubelet/pods/6364c9d0-5a44-43ad-a031-dfc3a0861a0e/volumes" Jul 23 22:30:28.947411 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:28.947382 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:30:29.048418 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:29.048384 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:30:31.659697 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:31.659659 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:30:31.752228 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:31.752181 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:30:32.178714 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:32.178682 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-zwtc9"] Jul 23 22:30:32.179064 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:32.179049 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6364c9d0-5a44-43ad-a031-dfc3a0861a0e" containerName="limitador" Jul 23 22:30:32.179064 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:32.179064 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="6364c9d0-5a44-43ad-a031-dfc3a0861a0e" containerName="limitador" Jul 23 22:30:32.179186 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:32.179071 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="465d9b56-c1b7-4330-88d2-cc56abb9ab26" containerName="authorino" Jul 23 22:30:32.179186 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:32.179077 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="465d9b56-c1b7-4330-88d2-cc56abb9ab26" containerName="authorino" Jul 23 22:30:32.179186 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:32.179137 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="465d9b56-c1b7-4330-88d2-cc56abb9ab26" containerName="authorino" Jul 23 22:30:32.179186 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:32.179146 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="6364c9d0-5a44-43ad-a031-dfc3a0861a0e" containerName="limitador" Jul 23 22:30:32.183515 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:32.183496 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zwtc9" Jul 23 22:30:32.186514 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:32.186497 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 23 22:30:32.186648 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:32.186629 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-rt6nn\"" Jul 23 22:30:32.187387 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:32.187370 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 23 22:30:32.187464 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:32.187400 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 23 22:30:32.193818 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:32.193801 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-zwtc9"] Jul 23 22:30:32.231727 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:32.231701 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:30:32.291484 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:32.291458 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6gtv\" (UniqueName: \"kubernetes.io/projected/11aea479-2d6a-4ef0-aae2-1924c2ee694c-kube-api-access-q6gtv\") pod \"postgres-69fb4594cf-zwtc9\" (UID: \"11aea479-2d6a-4ef0-aae2-1924c2ee694c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zwtc9" Jul 23 22:30:32.291598 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:32.291513 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/11aea479-2d6a-4ef0-aae2-1924c2ee694c-data\") pod \"postgres-69fb4594cf-zwtc9\" (UID: \"11aea479-2d6a-4ef0-aae2-1924c2ee694c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zwtc9" Jul 23 22:30:32.392071 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:32.392049 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6gtv\" (UniqueName: \"kubernetes.io/projected/11aea479-2d6a-4ef0-aae2-1924c2ee694c-kube-api-access-q6gtv\") pod \"postgres-69fb4594cf-zwtc9\" (UID: \"11aea479-2d6a-4ef0-aae2-1924c2ee694c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zwtc9" Jul 23 22:30:32.392181 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:32.392085 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/11aea479-2d6a-4ef0-aae2-1924c2ee694c-data\") pod \"postgres-69fb4594cf-zwtc9\" (UID: \"11aea479-2d6a-4ef0-aae2-1924c2ee694c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zwtc9" Jul 23 22:30:32.392443 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:32.392426 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/11aea479-2d6a-4ef0-aae2-1924c2ee694c-data\") pod \"postgres-69fb4594cf-zwtc9\" (UID: \"11aea479-2d6a-4ef0-aae2-1924c2ee694c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zwtc9" Jul 23 22:30:32.400342 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:32.400322 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6gtv\" (UniqueName: \"kubernetes.io/projected/11aea479-2d6a-4ef0-aae2-1924c2ee694c-kube-api-access-q6gtv\") pod \"postgres-69fb4594cf-zwtc9\" (UID: \"11aea479-2d6a-4ef0-aae2-1924c2ee694c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zwtc9" Jul 23 22:30:32.493598 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:32.493546 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zwtc9" Jul 23 22:30:32.627166 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:32.627140 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-zwtc9"] Jul 23 22:30:32.628941 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:30:32.628916 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11aea479_2d6a_4ef0_aae2_1924c2ee694c.slice/crio-08702605fe9c432aa4cb0bde208ad76c592b208b234ffc242ff9c67b4ca50415 WatchSource:0}: Error finding container 08702605fe9c432aa4cb0bde208ad76c592b208b234ffc242ff9c67b4ca50415: Status 404 returned error can't find the container with id 08702605fe9c432aa4cb0bde208ad76c592b208b234ffc242ff9c67b4ca50415 Jul 23 22:30:33.061099 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:33.061072 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zwtc9" event={"ID":"11aea479-2d6a-4ef0-aae2-1924c2ee694c","Type":"ContainerStarted","Data":"08702605fe9c432aa4cb0bde208ad76c592b208b234ffc242ff9c67b4ca50415"} Jul 23 22:30:36.558814 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:36.558773 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:30:36.661162 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:36.661125 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:30:38.095655 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:38.095618 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zwtc9" event={"ID":"11aea479-2d6a-4ef0-aae2-1924c2ee694c","Type":"ContainerStarted","Data":"0bc43ebb8944a6e0662264218615f26ba8f7aa882f0988b64419e4d30be0a960"} Jul 23 22:30:38.095973 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:38.095682 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zwtc9" Jul 23 22:30:38.113785 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:38.113739 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zwtc9" podStartSLOduration=1.151607171 podStartE2EDuration="6.113724662s" totalImagesPullingTime="4.962117491s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 22:30:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:30:38.112511786 +0000 UTC m=+465.832509047" watchObservedRunningTime="2026-07-23 22:30:38.113724662 +0000 UTC m=+465.833721921" Jul 23 22:30:44.133107 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:44.133076 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zwtc9" Jul 23 22:30:44.550674 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:44.550643 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:30:44.777190 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:44.777162 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:30:44.784691 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:44.784660 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kfxwt"] Jul 23 22:30:44.790496 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:44.790478 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-kfxwt" Jul 23 22:30:44.798123 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:44.798100 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kfxwt"] Jul 23 22:30:44.896642 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:44.896569 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnbbv\" (UniqueName: \"kubernetes.io/projected/bfa89646-3e84-4dc7-b516-3b20f426f953-kube-api-access-wnbbv\") pod \"authorino-5d4b67c446-kfxwt\" (UID: \"bfa89646-3e84-4dc7-b516-3b20f426f953\") " pod="kuadrant-system/authorino-5d4b67c446-kfxwt" Jul 23 22:30:44.974772 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:44.974741 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kfxwt"] Jul 23 22:30:44.974941 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:30:44.974923 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-wnbbv], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-kfxwt" podUID="bfa89646-3e84-4dc7-b516-3b20f426f953" Jul 23 22:30:44.997951 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:44.997922 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnbbv\" (UniqueName: \"kubernetes.io/projected/bfa89646-3e84-4dc7-b516-3b20f426f953-kube-api-access-wnbbv\") pod \"authorino-5d4b67c446-kfxwt\" (UID: \"bfa89646-3e84-4dc7-b516-3b20f426f953\") " pod="kuadrant-system/authorino-5d4b67c446-kfxwt" Jul 23 22:30:45.004716 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:45.004691 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76877994-q7bzn"] Jul 23 22:30:45.008225 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:45.008206 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-q7bzn" Jul 23 22:30:45.008835 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:45.008817 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnbbv\" (UniqueName: \"kubernetes.io/projected/bfa89646-3e84-4dc7-b516-3b20f426f953-kube-api-access-wnbbv\") pod \"authorino-5d4b67c446-kfxwt\" (UID: \"bfa89646-3e84-4dc7-b516-3b20f426f953\") " pod="kuadrant-system/authorino-5d4b67c446-kfxwt" Jul 23 22:30:45.010532 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:45.010516 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 23 22:30:45.016983 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:45.016965 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76877994-q7bzn"] Jul 23 22:30:45.039389 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:45.039366 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-q7bzn"] Jul 23 22:30:45.039550 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:30:45.039532 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-qm24c tls-cert], unattached volumes=[], failed to process volumes=[kube-api-access-qm24c tls-cert]: context canceled" pod="kuadrant-system/authorino-76877994-q7bzn" podUID="a9a5d41c-bbac-4d08-a603-edff54f6fbf4" Jul 23 22:30:45.067081 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:45.067059 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6667d9f684-nprbd"] Jul 23 22:30:45.070253 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:45.070238 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6667d9f684-nprbd" Jul 23 22:30:45.077724 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:45.077694 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6667d9f684-nprbd"] Jul 23 22:30:45.134999 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:45.134977 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-q7bzn" Jul 23 22:30:45.135303 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:45.134981 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-kfxwt" Jul 23 22:30:45.140927 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:45.140911 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-q7bzn" Jul 23 22:30:45.144134 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:45.144118 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-kfxwt" Jul 23 22:30:45.200443 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:45.200423 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lqp2\" (UniqueName: \"kubernetes.io/projected/f4f00035-5ade-45dd-b277-c9edf696e309-kube-api-access-2lqp2\") pod \"authorino-6667d9f684-nprbd\" (UID: \"f4f00035-5ade-45dd-b277-c9edf696e309\") " pod="kuadrant-system/authorino-6667d9f684-nprbd" Jul 23 22:30:45.200536 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:45.200449 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qm24c\" (UniqueName: \"kubernetes.io/projected/a9a5d41c-bbac-4d08-a603-edff54f6fbf4-kube-api-access-qm24c\") pod \"authorino-76877994-q7bzn\" (UID: \"a9a5d41c-bbac-4d08-a603-edff54f6fbf4\") " pod="kuadrant-system/authorino-76877994-q7bzn" Jul 23 22:30:45.200536 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:45.200521 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f4f00035-5ade-45dd-b277-c9edf696e309-tls-cert\") pod \"authorino-6667d9f684-nprbd\" (UID: \"f4f00035-5ade-45dd-b277-c9edf696e309\") " pod="kuadrant-system/authorino-6667d9f684-nprbd" Jul 23 22:30:45.200622 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:45.200543 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a9a5d41c-bbac-4d08-a603-edff54f6fbf4-tls-cert\") pod \"authorino-76877994-q7bzn\" (UID: \"a9a5d41c-bbac-4d08-a603-edff54f6fbf4\") " pod="kuadrant-system/authorino-76877994-q7bzn" Jul 23 22:30:45.301434 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:45.301411 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wnbbv\" (UniqueName: \"kubernetes.io/projected/bfa89646-3e84-4dc7-b516-3b20f426f953-kube-api-access-wnbbv\") pod \"bfa89646-3e84-4dc7-b516-3b20f426f953\" (UID: \"bfa89646-3e84-4dc7-b516-3b20f426f953\") " Jul 23 22:30:45.301529 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:45.301503 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lqp2\" (UniqueName: \"kubernetes.io/projected/f4f00035-5ade-45dd-b277-c9edf696e309-kube-api-access-2lqp2\") pod \"authorino-6667d9f684-nprbd\" (UID: \"f4f00035-5ade-45dd-b277-c9edf696e309\") " pod="kuadrant-system/authorino-6667d9f684-nprbd" Jul 23 22:30:45.301529 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:45.301522 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qm24c\" (UniqueName: \"kubernetes.io/projected/a9a5d41c-bbac-4d08-a603-edff54f6fbf4-kube-api-access-qm24c\") pod \"authorino-76877994-q7bzn\" (UID: \"a9a5d41c-bbac-4d08-a603-edff54f6fbf4\") " pod="kuadrant-system/authorino-76877994-q7bzn" Jul 23 22:30:45.301652 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:45.301561 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f4f00035-5ade-45dd-b277-c9edf696e309-tls-cert\") pod \"authorino-6667d9f684-nprbd\" (UID: \"f4f00035-5ade-45dd-b277-c9edf696e309\") " pod="kuadrant-system/authorino-6667d9f684-nprbd" Jul 23 22:30:45.301652 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:45.301588 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a9a5d41c-bbac-4d08-a603-edff54f6fbf4-tls-cert\") pod \"authorino-76877994-q7bzn\" (UID: \"a9a5d41c-bbac-4d08-a603-edff54f6fbf4\") " pod="kuadrant-system/authorino-76877994-q7bzn" Jul 23 22:30:45.303606 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:45.303579 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfa89646-3e84-4dc7-b516-3b20f426f953-kube-api-access-wnbbv" (OuterVolumeSpecName: "kube-api-access-wnbbv") pod "bfa89646-3e84-4dc7-b516-3b20f426f953" (UID: "bfa89646-3e84-4dc7-b516-3b20f426f953"). InnerVolumeSpecName "kube-api-access-wnbbv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 22:30:45.303931 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:45.303914 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f4f00035-5ade-45dd-b277-c9edf696e309-tls-cert\") pod \"authorino-6667d9f684-nprbd\" (UID: \"f4f00035-5ade-45dd-b277-c9edf696e309\") " pod="kuadrant-system/authorino-6667d9f684-nprbd" Jul 23 22:30:45.303977 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:45.303954 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a9a5d41c-bbac-4d08-a603-edff54f6fbf4-tls-cert\") pod \"authorino-76877994-q7bzn\" (UID: \"a9a5d41c-bbac-4d08-a603-edff54f6fbf4\") " pod="kuadrant-system/authorino-76877994-q7bzn" Jul 23 22:30:45.310011 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:45.309986 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qm24c\" (UniqueName: \"kubernetes.io/projected/a9a5d41c-bbac-4d08-a603-edff54f6fbf4-kube-api-access-qm24c\") pod \"authorino-76877994-q7bzn\" (UID: \"a9a5d41c-bbac-4d08-a603-edff54f6fbf4\") " pod="kuadrant-system/authorino-76877994-q7bzn" Jul 23 22:30:45.311179 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:45.311163 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lqp2\" (UniqueName: \"kubernetes.io/projected/f4f00035-5ade-45dd-b277-c9edf696e309-kube-api-access-2lqp2\") pod \"authorino-6667d9f684-nprbd\" (UID: \"f4f00035-5ade-45dd-b277-c9edf696e309\") " pod="kuadrant-system/authorino-6667d9f684-nprbd" Jul 23 22:30:45.378652 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:45.378631 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6667d9f684-nprbd" Jul 23 22:30:45.402300 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:45.402274 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a9a5d41c-bbac-4d08-a603-edff54f6fbf4-tls-cert\") pod \"a9a5d41c-bbac-4d08-a603-edff54f6fbf4\" (UID: \"a9a5d41c-bbac-4d08-a603-edff54f6fbf4\") " Jul 23 22:30:45.402474 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:45.402461 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wnbbv\" (UniqueName: \"kubernetes.io/projected/bfa89646-3e84-4dc7-b516-3b20f426f953-kube-api-access-wnbbv\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 22:30:45.404098 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:45.404072 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9a5d41c-bbac-4d08-a603-edff54f6fbf4-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "a9a5d41c-bbac-4d08-a603-edff54f6fbf4" (UID: "a9a5d41c-bbac-4d08-a603-edff54f6fbf4"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 22:30:45.503622 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:45.503590 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qm24c\" (UniqueName: \"kubernetes.io/projected/a9a5d41c-bbac-4d08-a603-edff54f6fbf4-kube-api-access-qm24c\") pod \"a9a5d41c-bbac-4d08-a603-edff54f6fbf4\" (UID: \"a9a5d41c-bbac-4d08-a603-edff54f6fbf4\") " Jul 23 22:30:45.503831 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:45.503816 2575 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a9a5d41c-bbac-4d08-a603-edff54f6fbf4-tls-cert\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 22:30:45.506317 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:45.506278 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9a5d41c-bbac-4d08-a603-edff54f6fbf4-kube-api-access-qm24c" (OuterVolumeSpecName: "kube-api-access-qm24c") pod "a9a5d41c-bbac-4d08-a603-edff54f6fbf4" (UID: "a9a5d41c-bbac-4d08-a603-edff54f6fbf4"). InnerVolumeSpecName "kube-api-access-qm24c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 22:30:45.535482 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:45.535450 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6667d9f684-nprbd"] Jul 23 22:30:45.537441 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:30:45.537412 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf4f00035_5ade_45dd_b277_c9edf696e309.slice/crio-42d057407712695e7a11f299311089a55a0b383a207e0c20bff1127511a330a9 WatchSource:0}: Error finding container 42d057407712695e7a11f299311089a55a0b383a207e0c20bff1127511a330a9: Status 404 returned error can't find the container with id 42d057407712695e7a11f299311089a55a0b383a207e0c20bff1127511a330a9 Jul 23 22:30:45.604601 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:45.604560 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qm24c\" (UniqueName: \"kubernetes.io/projected/a9a5d41c-bbac-4d08-a603-edff54f6fbf4-kube-api-access-qm24c\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 22:30:46.142346 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:46.142320 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6667d9f684-nprbd" event={"ID":"f4f00035-5ade-45dd-b277-c9edf696e309","Type":"ContainerStarted","Data":"42d057407712695e7a11f299311089a55a0b383a207e0c20bff1127511a330a9"} Jul 23 22:30:46.142750 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:46.142368 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-kfxwt" Jul 23 22:30:46.142750 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:46.142368 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-q7bzn" Jul 23 22:30:46.175041 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:46.174999 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-q7bzn"] Jul 23 22:30:46.178877 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:46.178856 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76877994-q7bzn"] Jul 23 22:30:46.205677 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:46.205552 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kfxwt"] Jul 23 22:30:46.207957 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:46.207934 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kfxwt"] Jul 23 22:30:46.807848 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:46.807822 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9a5d41c-bbac-4d08-a603-edff54f6fbf4" path="/var/lib/kubelet/pods/a9a5d41c-bbac-4d08-a603-edff54f6fbf4/volumes" Jul 23 22:30:46.808057 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:46.808044 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bfa89646-3e84-4dc7-b516-3b20f426f953" path="/var/lib/kubelet/pods/bfa89646-3e84-4dc7-b516-3b20f426f953/volumes" Jul 23 22:30:47.148674 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:47.148607 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6667d9f684-nprbd" event={"ID":"f4f00035-5ade-45dd-b277-c9edf696e309","Type":"ContainerStarted","Data":"1f650d4e6e369128f68aea0047befb2cd287a7d91507a683f98d4053c42f41de"} Jul 23 22:30:47.177597 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:47.177550 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6667d9f684-nprbd" podStartSLOduration=1.644627083 podStartE2EDuration="2.177535548s" totalImagesPullingTime="532.908465ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 22:30:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:30:47.175906975 +0000 UTC m=+474.895904236" watchObservedRunningTime="2026-07-23 22:30:47.177535548 +0000 UTC m=+474.897532807" Jul 23 22:30:47.223729 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:47.223700 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-t22l7"] Jul 23 22:30:47.223913 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:47.223892 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-t22l7" podUID="a867c45c-48e6-4abe-95f9-922f9b507d15" containerName="authorino" containerID="cri-o://688bfbd0ba2e11b233a82e8dc9b18b0dd42b705073e6bb7051dc1e68d35696f6" gracePeriod=30 Jul 23 22:30:47.502120 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:47.502099 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-t22l7" Jul 23 22:30:47.619260 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:47.619229 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p9fpv\" (UniqueName: \"kubernetes.io/projected/a867c45c-48e6-4abe-95f9-922f9b507d15-kube-api-access-p9fpv\") pod \"a867c45c-48e6-4abe-95f9-922f9b507d15\" (UID: \"a867c45c-48e6-4abe-95f9-922f9b507d15\") " Jul 23 22:30:47.621196 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:47.621171 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a867c45c-48e6-4abe-95f9-922f9b507d15-kube-api-access-p9fpv" (OuterVolumeSpecName: "kube-api-access-p9fpv") pod "a867c45c-48e6-4abe-95f9-922f9b507d15" (UID: "a867c45c-48e6-4abe-95f9-922f9b507d15"). InnerVolumeSpecName "kube-api-access-p9fpv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 22:30:47.719710 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:47.719688 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p9fpv\" (UniqueName: \"kubernetes.io/projected/a867c45c-48e6-4abe-95f9-922f9b507d15-kube-api-access-p9fpv\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 22:30:48.155195 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:48.155121 2575 generic.go:356] "Generic (PLEG): container finished" podID="a867c45c-48e6-4abe-95f9-922f9b507d15" containerID="688bfbd0ba2e11b233a82e8dc9b18b0dd42b705073e6bb7051dc1e68d35696f6" exitCode=0 Jul 23 22:30:48.155195 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:48.155188 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-t22l7" Jul 23 22:30:48.155583 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:48.155212 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-t22l7" event={"ID":"a867c45c-48e6-4abe-95f9-922f9b507d15","Type":"ContainerDied","Data":"688bfbd0ba2e11b233a82e8dc9b18b0dd42b705073e6bb7051dc1e68d35696f6"} Jul 23 22:30:48.155583 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:48.155263 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-t22l7" event={"ID":"a867c45c-48e6-4abe-95f9-922f9b507d15","Type":"ContainerDied","Data":"40fe71125500b5f0bb8ba436c97e40d9a2ab93e03f104196b03b0927ac39de9f"} Jul 23 22:30:48.155583 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:48.155286 2575 scope.go:117] "RemoveContainer" containerID="688bfbd0ba2e11b233a82e8dc9b18b0dd42b705073e6bb7051dc1e68d35696f6" Jul 23 22:30:48.164807 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:48.164791 2575 scope.go:117] "RemoveContainer" containerID="688bfbd0ba2e11b233a82e8dc9b18b0dd42b705073e6bb7051dc1e68d35696f6" Jul 23 22:30:48.165059 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:30:48.165040 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"688bfbd0ba2e11b233a82e8dc9b18b0dd42b705073e6bb7051dc1e68d35696f6\": container with ID starting with 688bfbd0ba2e11b233a82e8dc9b18b0dd42b705073e6bb7051dc1e68d35696f6 not found: ID does not exist" containerID="688bfbd0ba2e11b233a82e8dc9b18b0dd42b705073e6bb7051dc1e68d35696f6" Jul 23 22:30:48.165110 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:48.165067 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"688bfbd0ba2e11b233a82e8dc9b18b0dd42b705073e6bb7051dc1e68d35696f6"} err="failed to get container status \"688bfbd0ba2e11b233a82e8dc9b18b0dd42b705073e6bb7051dc1e68d35696f6\": rpc error: code = NotFound desc = could not find container \"688bfbd0ba2e11b233a82e8dc9b18b0dd42b705073e6bb7051dc1e68d35696f6\": container with ID starting with 688bfbd0ba2e11b233a82e8dc9b18b0dd42b705073e6bb7051dc1e68d35696f6 not found: ID does not exist" Jul 23 22:30:48.177429 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:48.177397 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-t22l7"] Jul 23 22:30:48.182179 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:48.182158 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-t22l7"] Jul 23 22:30:48.807362 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:48.807327 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a867c45c-48e6-4abe-95f9-922f9b507d15" path="/var/lib/kubelet/pods/a867c45c-48e6-4abe-95f9-922f9b507d15/volumes" Jul 23 22:30:52.057574 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:52.057538 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:30:52.066744 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:52.066717 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-65c7dc7b4c-bstkf"] Jul 23 22:30:52.067175 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:52.067132 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a867c45c-48e6-4abe-95f9-922f9b507d15" containerName="authorino" Jul 23 22:30:52.067175 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:52.067152 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a867c45c-48e6-4abe-95f9-922f9b507d15" containerName="authorino" Jul 23 22:30:52.067388 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:52.067282 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="a867c45c-48e6-4abe-95f9-922f9b507d15" containerName="authorino" Jul 23 22:30:52.081612 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:52.081588 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-65c7dc7b4c-bstkf"] Jul 23 22:30:52.081762 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:52.081687 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65c7dc7b4c-bstkf" Jul 23 22:30:52.084244 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:52.084225 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 23 22:30:52.084368 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:52.084334 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 23 22:30:52.084368 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:52.084345 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-8frc5\"" Jul 23 22:30:52.149125 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:52.149093 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vvrj\" (UniqueName: \"kubernetes.io/projected/00a35b9e-29fb-409e-afdd-829ac0ec7f18-kube-api-access-5vvrj\") pod \"maas-controller-65c7dc7b4c-bstkf\" (UID: \"00a35b9e-29fb-409e-afdd-829ac0ec7f18\") " pod="opendatahub/maas-controller-65c7dc7b4c-bstkf" Jul 23 22:30:52.149246 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:52.149169 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/00a35b9e-29fb-409e-afdd-829ac0ec7f18-webhook-cert\") pod \"maas-controller-65c7dc7b4c-bstkf\" (UID: \"00a35b9e-29fb-409e-afdd-829ac0ec7f18\") " pod="opendatahub/maas-controller-65c7dc7b4c-bstkf" Jul 23 22:30:52.155337 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:52.155313 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:30:52.245779 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:52.245758 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:30:52.247140 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:52.247121 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7845c898b6-x29w9"] Jul 23 22:30:52.249430 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:52.249401 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7845c898b6-x29w9" Jul 23 22:30:52.249757 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:52.249739 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vvrj\" (UniqueName: \"kubernetes.io/projected/00a35b9e-29fb-409e-afdd-829ac0ec7f18-kube-api-access-5vvrj\") pod \"maas-controller-65c7dc7b4c-bstkf\" (UID: \"00a35b9e-29fb-409e-afdd-829ac0ec7f18\") " pod="opendatahub/maas-controller-65c7dc7b4c-bstkf" Jul 23 22:30:52.249818 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:52.249784 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e74b6a97-3719-46c6-b17d-d66bd1472054-webhook-cert\") pod \"maas-controller-7845c898b6-x29w9\" (UID: \"e74b6a97-3719-46c6-b17d-d66bd1472054\") " pod="opendatahub/maas-controller-7845c898b6-x29w9" Jul 23 22:30:52.249874 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:52.249831 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/00a35b9e-29fb-409e-afdd-829ac0ec7f18-webhook-cert\") pod \"maas-controller-65c7dc7b4c-bstkf\" (UID: \"00a35b9e-29fb-409e-afdd-829ac0ec7f18\") " pod="opendatahub/maas-controller-65c7dc7b4c-bstkf" Jul 23 22:30:52.249874 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:52.249849 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9k9gb\" (UniqueName: \"kubernetes.io/projected/e74b6a97-3719-46c6-b17d-d66bd1472054-kube-api-access-9k9gb\") pod \"maas-controller-7845c898b6-x29w9\" (UID: \"e74b6a97-3719-46c6-b17d-d66bd1472054\") " pod="opendatahub/maas-controller-7845c898b6-x29w9" Jul 23 22:30:52.249990 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:30:52.249938 2575 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jul 23 22:30:52.249990 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:30:52.249984 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00a35b9e-29fb-409e-afdd-829ac0ec7f18-webhook-cert podName:00a35b9e-29fb-409e-afdd-829ac0ec7f18 nodeName:}" failed. No retries permitted until 2026-07-23 22:30:52.749969565 +0000 UTC m=+480.469966821 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/00a35b9e-29fb-409e-afdd-829ac0ec7f18-webhook-cert") pod "maas-controller-65c7dc7b4c-bstkf" (UID: "00a35b9e-29fb-409e-afdd-829ac0ec7f18") : secret "maas-controller-webhook-cert" not found Jul 23 22:30:52.260782 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:52.260754 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vvrj\" (UniqueName: \"kubernetes.io/projected/00a35b9e-29fb-409e-afdd-829ac0ec7f18-kube-api-access-5vvrj\") pod \"maas-controller-65c7dc7b4c-bstkf\" (UID: \"00a35b9e-29fb-409e-afdd-829ac0ec7f18\") " pod="opendatahub/maas-controller-65c7dc7b4c-bstkf" Jul 23 22:30:52.260948 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:52.260928 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7845c898b6-x29w9"] Jul 23 22:30:52.350876 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:52.350823 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e74b6a97-3719-46c6-b17d-d66bd1472054-webhook-cert\") pod \"maas-controller-7845c898b6-x29w9\" (UID: \"e74b6a97-3719-46c6-b17d-d66bd1472054\") " pod="opendatahub/maas-controller-7845c898b6-x29w9" Jul 23 22:30:52.350965 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:52.350877 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9k9gb\" (UniqueName: \"kubernetes.io/projected/e74b6a97-3719-46c6-b17d-d66bd1472054-kube-api-access-9k9gb\") pod \"maas-controller-7845c898b6-x29w9\" (UID: \"e74b6a97-3719-46c6-b17d-d66bd1472054\") " pod="opendatahub/maas-controller-7845c898b6-x29w9" Jul 23 22:30:52.353118 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:52.353089 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e74b6a97-3719-46c6-b17d-d66bd1472054-webhook-cert\") pod \"maas-controller-7845c898b6-x29w9\" (UID: \"e74b6a97-3719-46c6-b17d-d66bd1472054\") " pod="opendatahub/maas-controller-7845c898b6-x29w9" Jul 23 22:30:52.360745 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:52.360717 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9k9gb\" (UniqueName: \"kubernetes.io/projected/e74b6a97-3719-46c6-b17d-d66bd1472054-kube-api-access-9k9gb\") pod \"maas-controller-7845c898b6-x29w9\" (UID: \"e74b6a97-3719-46c6-b17d-d66bd1472054\") " pod="opendatahub/maas-controller-7845c898b6-x29w9" Jul 23 22:30:52.367504 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:52.367483 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:30:52.559953 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:52.559931 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7845c898b6-x29w9" Jul 23 22:30:52.689374 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:52.689346 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7845c898b6-x29w9"] Jul 23 22:30:52.692439 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:30:52.692414 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode74b6a97_3719_46c6_b17d_d66bd1472054.slice/crio-7b4eefcba82e0d38a0c940b324430ecffad34e36456e33d4c6f4fd5f28ba1cae WatchSource:0}: Error finding container 7b4eefcba82e0d38a0c940b324430ecffad34e36456e33d4c6f4fd5f28ba1cae: Status 404 returned error can't find the container with id 7b4eefcba82e0d38a0c940b324430ecffad34e36456e33d4c6f4fd5f28ba1cae Jul 23 22:30:52.753491 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:52.753468 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/00a35b9e-29fb-409e-afdd-829ac0ec7f18-webhook-cert\") pod \"maas-controller-65c7dc7b4c-bstkf\" (UID: \"00a35b9e-29fb-409e-afdd-829ac0ec7f18\") " pod="opendatahub/maas-controller-65c7dc7b4c-bstkf" Jul 23 22:30:52.755704 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:52.755685 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/00a35b9e-29fb-409e-afdd-829ac0ec7f18-webhook-cert\") pod \"maas-controller-65c7dc7b4c-bstkf\" (UID: \"00a35b9e-29fb-409e-afdd-829ac0ec7f18\") " pod="opendatahub/maas-controller-65c7dc7b4c-bstkf" Jul 23 22:30:52.993156 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:52.993133 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65c7dc7b4c-bstkf" Jul 23 22:30:53.120960 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:53.120934 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-65c7dc7b4c-bstkf"] Jul 23 22:30:53.122813 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:30:53.122788 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00a35b9e_29fb_409e_afdd_829ac0ec7f18.slice/crio-51a02afdf89bd3c07072f246f26ec6e87c3d91ff10aeb1d098888e5be55ef3f6 WatchSource:0}: Error finding container 51a02afdf89bd3c07072f246f26ec6e87c3d91ff10aeb1d098888e5be55ef3f6: Status 404 returned error can't find the container with id 51a02afdf89bd3c07072f246f26ec6e87c3d91ff10aeb1d098888e5be55ef3f6 Jul 23 22:30:53.184611 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:53.184579 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7845c898b6-x29w9" event={"ID":"e74b6a97-3719-46c6-b17d-d66bd1472054","Type":"ContainerStarted","Data":"7b4eefcba82e0d38a0c940b324430ecffad34e36456e33d4c6f4fd5f28ba1cae"} Jul 23 22:30:53.186071 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:53.186041 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65c7dc7b4c-bstkf" event={"ID":"00a35b9e-29fb-409e-afdd-829ac0ec7f18","Type":"ContainerStarted","Data":"51a02afdf89bd3c07072f246f26ec6e87c3d91ff10aeb1d098888e5be55ef3f6"} Jul 23 22:30:55.028339 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:55.028314 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 23 22:30:55.202333 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:55.202280 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65c7dc7b4c-bstkf" event={"ID":"00a35b9e-29fb-409e-afdd-829ac0ec7f18","Type":"ContainerStarted","Data":"5a67d4ae12a455575e0c9baaf43fdae62eb14108513ffbee9369b1caa8383bce"} Jul 23 22:30:55.202564 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:55.202468 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-65c7dc7b4c-bstkf" Jul 23 22:30:55.203936 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:55.203910 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7845c898b6-x29w9" event={"ID":"e74b6a97-3719-46c6-b17d-d66bd1472054","Type":"ContainerStarted","Data":"19b3030ee2020a8d7601389ecab058c3da5babfada6fd5008fad562cb0aa8756"} Jul 23 22:30:55.204075 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:55.204044 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7845c898b6-x29w9" Jul 23 22:30:55.224720 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:55.224685 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:30:55.228490 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:55.228451 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-65c7dc7b4c-bstkf" podStartSLOduration=1.321298455 podStartE2EDuration="3.228437463s" totalImagesPullingTime="1.907139008s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 22:30:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:30:55.226815357 +0000 UTC m=+482.946812636" watchObservedRunningTime="2026-07-23 22:30:55.228437463 +0000 UTC m=+482.948434724" Jul 23 22:30:55.265621 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:55.265580 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7845c898b6-x29w9" podStartSLOduration=0.934325347 podStartE2EDuration="3.265566769s" totalImagesPullingTime="2.331241422s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 22:30:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:30:55.263879269 +0000 UTC m=+482.983876528" watchObservedRunningTime="2026-07-23 22:30:55.265566769 +0000 UTC m=+482.985564384" Jul 23 22:30:55.314456 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:30:55.314393 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:31:06.210287 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:06.210258 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-65c7dc7b4c-bstkf" Jul 23 22:31:06.210747 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:06.210344 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7845c898b6-x29w9" Jul 23 22:31:06.272444 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:06.272412 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-65c7dc7b4c-bstkf"] Jul 23 22:31:06.272793 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:06.272763 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-65c7dc7b4c-bstkf" podUID="00a35b9e-29fb-409e-afdd-829ac0ec7f18" containerName="manager" containerID="cri-o://5a67d4ae12a455575e0c9baaf43fdae62eb14108513ffbee9369b1caa8383bce" gracePeriod=30 Jul 23 22:31:06.512886 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:06.512860 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65c7dc7b4c-bstkf" Jul 23 22:31:06.555114 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:06.555090 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5vvrj\" (UniqueName: \"kubernetes.io/projected/00a35b9e-29fb-409e-afdd-829ac0ec7f18-kube-api-access-5vvrj\") pod \"00a35b9e-29fb-409e-afdd-829ac0ec7f18\" (UID: \"00a35b9e-29fb-409e-afdd-829ac0ec7f18\") " Jul 23 22:31:06.555233 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:06.555166 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/00a35b9e-29fb-409e-afdd-829ac0ec7f18-webhook-cert\") pod \"00a35b9e-29fb-409e-afdd-829ac0ec7f18\" (UID: \"00a35b9e-29fb-409e-afdd-829ac0ec7f18\") " Jul 23 22:31:06.557168 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:06.557142 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00a35b9e-29fb-409e-afdd-829ac0ec7f18-kube-api-access-5vvrj" (OuterVolumeSpecName: "kube-api-access-5vvrj") pod "00a35b9e-29fb-409e-afdd-829ac0ec7f18" (UID: "00a35b9e-29fb-409e-afdd-829ac0ec7f18"). InnerVolumeSpecName "kube-api-access-5vvrj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 22:31:06.557236 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:06.557165 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00a35b9e-29fb-409e-afdd-829ac0ec7f18-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "00a35b9e-29fb-409e-afdd-829ac0ec7f18" (UID: "00a35b9e-29fb-409e-afdd-829ac0ec7f18"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 22:31:06.656571 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:06.656547 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5vvrj\" (UniqueName: \"kubernetes.io/projected/00a35b9e-29fb-409e-afdd-829ac0ec7f18-kube-api-access-5vvrj\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 22:31:06.656571 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:06.656567 2575 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/00a35b9e-29fb-409e-afdd-829ac0ec7f18-webhook-cert\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 22:31:07.265910 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:07.265871 2575 generic.go:356] "Generic (PLEG): container finished" podID="00a35b9e-29fb-409e-afdd-829ac0ec7f18" containerID="5a67d4ae12a455575e0c9baaf43fdae62eb14108513ffbee9369b1caa8383bce" exitCode=0 Jul 23 22:31:07.265910 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:07.265912 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65c7dc7b4c-bstkf" Jul 23 22:31:07.266361 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:07.265922 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65c7dc7b4c-bstkf" event={"ID":"00a35b9e-29fb-409e-afdd-829ac0ec7f18","Type":"ContainerDied","Data":"5a67d4ae12a455575e0c9baaf43fdae62eb14108513ffbee9369b1caa8383bce"} Jul 23 22:31:07.266361 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:07.265962 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65c7dc7b4c-bstkf" event={"ID":"00a35b9e-29fb-409e-afdd-829ac0ec7f18","Type":"ContainerDied","Data":"51a02afdf89bd3c07072f246f26ec6e87c3d91ff10aeb1d098888e5be55ef3f6"} Jul 23 22:31:07.266361 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:07.265982 2575 scope.go:117] "RemoveContainer" containerID="5a67d4ae12a455575e0c9baaf43fdae62eb14108513ffbee9369b1caa8383bce" Jul 23 22:31:07.274855 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:07.274716 2575 scope.go:117] "RemoveContainer" containerID="5a67d4ae12a455575e0c9baaf43fdae62eb14108513ffbee9369b1caa8383bce" Jul 23 22:31:07.274990 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:31:07.274967 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a67d4ae12a455575e0c9baaf43fdae62eb14108513ffbee9369b1caa8383bce\": container with ID starting with 5a67d4ae12a455575e0c9baaf43fdae62eb14108513ffbee9369b1caa8383bce not found: ID does not exist" containerID="5a67d4ae12a455575e0c9baaf43fdae62eb14108513ffbee9369b1caa8383bce" Jul 23 22:31:07.275057 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:07.274998 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a67d4ae12a455575e0c9baaf43fdae62eb14108513ffbee9369b1caa8383bce"} err="failed to get container status \"5a67d4ae12a455575e0c9baaf43fdae62eb14108513ffbee9369b1caa8383bce\": rpc error: code = NotFound desc = could not find container \"5a67d4ae12a455575e0c9baaf43fdae62eb14108513ffbee9369b1caa8383bce\": container with ID starting with 5a67d4ae12a455575e0c9baaf43fdae62eb14108513ffbee9369b1caa8383bce not found: ID does not exist" Jul 23 22:31:07.283043 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:07.283002 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-65c7dc7b4c-bstkf"] Jul 23 22:31:07.286570 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:07.286550 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-65c7dc7b4c-bstkf"] Jul 23 22:31:08.807283 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:08.807253 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00a35b9e-29fb-409e-afdd-829ac0ec7f18" path="/var/lib/kubelet/pods/00a35b9e-29fb-409e-afdd-829ac0ec7f18/volumes" Jul 23 22:31:28.872547 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:28.872512 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:31:28.958513 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:28.958480 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:31:29.465033 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:29.464977 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:31:29.609804 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:29.609774 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6c948d5d44-m6sr5"] Jul 23 22:31:29.610246 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:29.610231 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00a35b9e-29fb-409e-afdd-829ac0ec7f18" containerName="manager" Jul 23 22:31:29.610312 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:29.610249 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="00a35b9e-29fb-409e-afdd-829ac0ec7f18" containerName="manager" Jul 23 22:31:29.610347 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:29.610314 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="00a35b9e-29fb-409e-afdd-829ac0ec7f18" containerName="manager" Jul 23 22:31:29.614519 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:29.614505 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6c948d5d44-m6sr5" Jul 23 22:31:29.616800 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:29.616775 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jul 23 22:31:29.616922 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:29.616813 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-vw8vx\"" Jul 23 22:31:29.624898 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:29.624874 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6c948d5d44-m6sr5"] Jul 23 22:31:29.720946 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:29.720888 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdzwd\" (UniqueName: \"kubernetes.io/projected/00d409e2-e5a6-45f1-9a54-7a6ab9a13c2b-kube-api-access-jdzwd\") pod \"maas-api-6c948d5d44-m6sr5\" (UID: \"00d409e2-e5a6-45f1-9a54-7a6ab9a13c2b\") " pod="odh-ai-gateway-infra/maas-api-6c948d5d44-m6sr5" Jul 23 22:31:29.720946 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:29.720917 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/00d409e2-e5a6-45f1-9a54-7a6ab9a13c2b-openshift-service-ca\") pod \"maas-api-6c948d5d44-m6sr5\" (UID: \"00d409e2-e5a6-45f1-9a54-7a6ab9a13c2b\") " pod="odh-ai-gateway-infra/maas-api-6c948d5d44-m6sr5" Jul 23 22:31:29.721121 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:29.720993 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00d409e2-e5a6-45f1-9a54-7a6ab9a13c2b-maas-api-tls\") pod \"maas-api-6c948d5d44-m6sr5\" (UID: \"00d409e2-e5a6-45f1-9a54-7a6ab9a13c2b\") " pod="odh-ai-gateway-infra/maas-api-6c948d5d44-m6sr5" Jul 23 22:31:29.821846 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:29.821812 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00d409e2-e5a6-45f1-9a54-7a6ab9a13c2b-maas-api-tls\") pod \"maas-api-6c948d5d44-m6sr5\" (UID: \"00d409e2-e5a6-45f1-9a54-7a6ab9a13c2b\") " pod="odh-ai-gateway-infra/maas-api-6c948d5d44-m6sr5" Jul 23 22:31:29.821964 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:29.821859 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdzwd\" (UniqueName: \"kubernetes.io/projected/00d409e2-e5a6-45f1-9a54-7a6ab9a13c2b-kube-api-access-jdzwd\") pod \"maas-api-6c948d5d44-m6sr5\" (UID: \"00d409e2-e5a6-45f1-9a54-7a6ab9a13c2b\") " pod="odh-ai-gateway-infra/maas-api-6c948d5d44-m6sr5" Jul 23 22:31:29.821964 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:29.821890 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/00d409e2-e5a6-45f1-9a54-7a6ab9a13c2b-openshift-service-ca\") pod \"maas-api-6c948d5d44-m6sr5\" (UID: \"00d409e2-e5a6-45f1-9a54-7a6ab9a13c2b\") " pod="odh-ai-gateway-infra/maas-api-6c948d5d44-m6sr5" Jul 23 22:31:29.821964 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:31:29.821952 2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jul 23 22:31:29.822118 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:31:29.822016 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00d409e2-e5a6-45f1-9a54-7a6ab9a13c2b-maas-api-tls podName:00d409e2-e5a6-45f1-9a54-7a6ab9a13c2b nodeName:}" failed. No retries permitted until 2026-07-23 22:31:30.321990467 +0000 UTC m=+518.041987712 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/00d409e2-e5a6-45f1-9a54-7a6ab9a13c2b-maas-api-tls") pod "maas-api-6c948d5d44-m6sr5" (UID: "00d409e2-e5a6-45f1-9a54-7a6ab9a13c2b") : secret "maas-api-serving-cert" not found Jul 23 22:31:29.822531 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:29.822505 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/00d409e2-e5a6-45f1-9a54-7a6ab9a13c2b-openshift-service-ca\") pod \"maas-api-6c948d5d44-m6sr5\" (UID: \"00d409e2-e5a6-45f1-9a54-7a6ab9a13c2b\") " pod="odh-ai-gateway-infra/maas-api-6c948d5d44-m6sr5" Jul 23 22:31:29.830393 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:29.830366 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdzwd\" (UniqueName: \"kubernetes.io/projected/00d409e2-e5a6-45f1-9a54-7a6ab9a13c2b-kube-api-access-jdzwd\") pod \"maas-api-6c948d5d44-m6sr5\" (UID: \"00d409e2-e5a6-45f1-9a54-7a6ab9a13c2b\") " pod="odh-ai-gateway-infra/maas-api-6c948d5d44-m6sr5" Jul 23 22:31:29.961903 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:29.961878 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:31:30.060537 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:30.060464 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:31:30.077319 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:30.077288 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-sbdtt"] Jul 23 22:31:30.079883 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:30.079866 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-sbdtt" Jul 23 22:31:30.082756 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:30.082740 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 23 22:31:30.082826 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:30.082778 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-q7fqm\"" Jul 23 22:31:30.090597 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:30.090576 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-9wvrc"] Jul 23 22:31:30.093000 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:30.092980 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-9wvrc" Jul 23 22:31:30.093917 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:30.093895 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-sbdtt"] Jul 23 22:31:30.105940 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:30.105916 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-9wvrc"] Jul 23 22:31:30.123596 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:30.123569 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qqht\" (UniqueName: \"kubernetes.io/projected/a5b6a8f7-a06a-4a1a-a4c8-19fe6713282c-kube-api-access-6qqht\") pod \"payload-processing-5cc6cd444b-9wvrc\" (UID: \"a5b6a8f7-a06a-4a1a-a4c8-19fe6713282c\") " pod="openshift-ingress/payload-processing-5cc6cd444b-9wvrc" Jul 23 22:31:30.123679 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:30.123621 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a5b6a8f7-a06a-4a1a-a4c8-19fe6713282c-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-9wvrc\" (UID: \"a5b6a8f7-a06a-4a1a-a4c8-19fe6713282c\") " pod="openshift-ingress/payload-processing-5cc6cd444b-9wvrc" Jul 23 22:31:30.123679 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:30.123644 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttdvq\" (UniqueName: \"kubernetes.io/projected/225675f4-74e4-44dd-975b-d4c4267ba68a-kube-api-access-ttdvq\") pod \"payload-pre-processing-687dbb6cf6-sbdtt\" (UID: \"225675f4-74e4-44dd-975b-d4c4267ba68a\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-sbdtt" Jul 23 22:31:30.123764 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:30.123746 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/225675f4-74e4-44dd-975b-d4c4267ba68a-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-sbdtt\" (UID: \"225675f4-74e4-44dd-975b-d4c4267ba68a\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-sbdtt" Jul 23 22:31:30.162999 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:30.162975 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:31:30.224678 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:30.224637 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qqht\" (UniqueName: \"kubernetes.io/projected/a5b6a8f7-a06a-4a1a-a4c8-19fe6713282c-kube-api-access-6qqht\") pod \"payload-processing-5cc6cd444b-9wvrc\" (UID: \"a5b6a8f7-a06a-4a1a-a4c8-19fe6713282c\") " pod="openshift-ingress/payload-processing-5cc6cd444b-9wvrc" Jul 23 22:31:30.224828 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:30.224713 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a5b6a8f7-a06a-4a1a-a4c8-19fe6713282c-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-9wvrc\" (UID: \"a5b6a8f7-a06a-4a1a-a4c8-19fe6713282c\") " pod="openshift-ingress/payload-processing-5cc6cd444b-9wvrc" Jul 23 22:31:30.224828 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:30.224733 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttdvq\" (UniqueName: \"kubernetes.io/projected/225675f4-74e4-44dd-975b-d4c4267ba68a-kube-api-access-ttdvq\") pod \"payload-pre-processing-687dbb6cf6-sbdtt\" (UID: \"225675f4-74e4-44dd-975b-d4c4267ba68a\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-sbdtt" Jul 23 22:31:30.224828 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:30.224787 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/225675f4-74e4-44dd-975b-d4c4267ba68a-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-sbdtt\" (UID: \"225675f4-74e4-44dd-975b-d4c4267ba68a\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-sbdtt" Jul 23 22:31:30.225540 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:30.225520 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/225675f4-74e4-44dd-975b-d4c4267ba68a-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-sbdtt\" (UID: \"225675f4-74e4-44dd-975b-d4c4267ba68a\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-sbdtt" Jul 23 22:31:30.225637 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:30.225565 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a5b6a8f7-a06a-4a1a-a4c8-19fe6713282c-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-9wvrc\" (UID: \"a5b6a8f7-a06a-4a1a-a4c8-19fe6713282c\") " pod="openshift-ingress/payload-processing-5cc6cd444b-9wvrc" Jul 23 22:31:30.240580 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:30.240556 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qqht\" (UniqueName: \"kubernetes.io/projected/a5b6a8f7-a06a-4a1a-a4c8-19fe6713282c-kube-api-access-6qqht\") pod \"payload-processing-5cc6cd444b-9wvrc\" (UID: \"a5b6a8f7-a06a-4a1a-a4c8-19fe6713282c\") " pod="openshift-ingress/payload-processing-5cc6cd444b-9wvrc" Jul 23 22:31:30.240580 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:30.240585 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttdvq\" (UniqueName: \"kubernetes.io/projected/225675f4-74e4-44dd-975b-d4c4267ba68a-kube-api-access-ttdvq\") pod \"payload-pre-processing-687dbb6cf6-sbdtt\" (UID: \"225675f4-74e4-44dd-975b-d4c4267ba68a\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-sbdtt" Jul 23 22:31:30.325940 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:30.325874 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00d409e2-e5a6-45f1-9a54-7a6ab9a13c2b-maas-api-tls\") pod \"maas-api-6c948d5d44-m6sr5\" (UID: \"00d409e2-e5a6-45f1-9a54-7a6ab9a13c2b\") " pod="odh-ai-gateway-infra/maas-api-6c948d5d44-m6sr5" Jul 23 22:31:30.328056 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:30.328035 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00d409e2-e5a6-45f1-9a54-7a6ab9a13c2b-maas-api-tls\") pod \"maas-api-6c948d5d44-m6sr5\" (UID: \"00d409e2-e5a6-45f1-9a54-7a6ab9a13c2b\") " pod="odh-ai-gateway-infra/maas-api-6c948d5d44-m6sr5" Jul 23 22:31:30.392480 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:30.392449 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-sbdtt" Jul 23 22:31:30.403990 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:30.403968 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-9wvrc" Jul 23 22:31:30.526296 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:30.526267 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6c948d5d44-m6sr5" Jul 23 22:31:30.536459 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:30.536435 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-sbdtt"] Jul 23 22:31:30.540291 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:31:30.540258 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod225675f4_74e4_44dd_975b_d4c4267ba68a.slice/crio-dd637967fa05fb01dd95403488a9c0d51563d640d00bbdeadce671875fcd7b6c WatchSource:0}: Error finding container dd637967fa05fb01dd95403488a9c0d51563d640d00bbdeadce671875fcd7b6c: Status 404 returned error can't find the container with id dd637967fa05fb01dd95403488a9c0d51563d640d00bbdeadce671875fcd7b6c Jul 23 22:31:30.567201 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:30.567177 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-9wvrc"] Jul 23 22:31:30.568258 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:31:30.568238 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5b6a8f7_a06a_4a1a_a4c8_19fe6713282c.slice/crio-10922b680fec3043a0c8820a7dec91bda1a3c0dc2cdbfd61f0c35e9c7f0f5f56 WatchSource:0}: Error finding container 10922b680fec3043a0c8820a7dec91bda1a3c0dc2cdbfd61f0c35e9c7f0f5f56: Status 404 returned error can't find the container with id 10922b680fec3043a0c8820a7dec91bda1a3c0dc2cdbfd61f0c35e9c7f0f5f56 Jul 23 22:31:30.667877 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:30.667855 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6c948d5d44-m6sr5"] Jul 23 22:31:30.668971 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:31:30.668947 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00d409e2_e5a6_45f1_9a54_7a6ab9a13c2b.slice/crio-07ccd36af46f947e04a15bc347da39573548ac46db4168d24b4212472afa7bbd WatchSource:0}: Error finding container 07ccd36af46f947e04a15bc347da39573548ac46db4168d24b4212472afa7bbd: Status 404 returned error can't find the container with id 07ccd36af46f947e04a15bc347da39573548ac46db4168d24b4212472afa7bbd Jul 23 22:31:31.398182 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:31.398148 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-9wvrc" event={"ID":"a5b6a8f7-a06a-4a1a-a4c8-19fe6713282c","Type":"ContainerStarted","Data":"10922b680fec3043a0c8820a7dec91bda1a3c0dc2cdbfd61f0c35e9c7f0f5f56"} Jul 23 22:31:31.401076 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:31.401012 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-sbdtt" event={"ID":"225675f4-74e4-44dd-975b-d4c4267ba68a","Type":"ContainerStarted","Data":"dd637967fa05fb01dd95403488a9c0d51563d640d00bbdeadce671875fcd7b6c"} Jul 23 22:31:31.402647 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:31.402590 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6c948d5d44-m6sr5" event={"ID":"00d409e2-e5a6-45f1-9a54-7a6ab9a13c2b","Type":"ContainerStarted","Data":"07ccd36af46f947e04a15bc347da39573548ac46db4168d24b4212472afa7bbd"} Jul 23 22:31:33.417087 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:33.417053 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-9wvrc" event={"ID":"a5b6a8f7-a06a-4a1a-a4c8-19fe6713282c","Type":"ContainerStarted","Data":"4259804f6c442561cd2160b1b191f93aa3f100b936a00ad33db7e6eb3b38b6b7"} Jul 23 22:31:33.417520 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:33.417174 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5cc6cd444b-9wvrc" Jul 23 22:31:33.418660 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:33.418636 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-sbdtt" event={"ID":"225675f4-74e4-44dd-975b-d4c4267ba68a","Type":"ContainerStarted","Data":"c5cceff43cd10fce56c6baa1dfb95b208e2efad1cf7f73cd806279a562ffef40"} Jul 23 22:31:33.418775 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:33.418698 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-sbdtt" Jul 23 22:31:33.420089 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:33.420066 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6c948d5d44-m6sr5" event={"ID":"00d409e2-e5a6-45f1-9a54-7a6ab9a13c2b","Type":"ContainerStarted","Data":"c30b26d211aa72369448229ff8501a2a8077f74ffd3492008aff5fa71ad4fc35"} Jul 23 22:31:33.420191 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:33.420113 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6c948d5d44-m6sr5" Jul 23 22:31:33.435013 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:33.434971 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5cc6cd444b-9wvrc" podStartSLOduration=1.2791860800000001 podStartE2EDuration="3.43495772s" totalImagesPullingTime="2.15577164s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 22:31:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:31:33.434380098 +0000 UTC m=+521.154377359" watchObservedRunningTime="2026-07-23 22:31:33.43495772 +0000 UTC m=+521.154954980" Jul 23 22:31:33.451854 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:33.451816 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6c948d5d44-m6sr5" podStartSLOduration=2.396391901 podStartE2EDuration="4.451805056s" totalImagesPullingTime="2.055413155s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 22:31:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:31:33.450159026 +0000 UTC m=+521.170156287" watchObservedRunningTime="2026-07-23 22:31:33.451805056 +0000 UTC m=+521.171802317" Jul 23 22:31:33.467183 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:33.467146 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-sbdtt" podStartSLOduration=1.273321986 podStartE2EDuration="3.467133283s" totalImagesPullingTime="2.193811297s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 22:31:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:31:33.465870092 +0000 UTC m=+521.185867359" watchObservedRunningTime="2026-07-23 22:31:33.467133283 +0000 UTC m=+521.187130543" Jul 23 22:31:39.431725 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:39.431696 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6c948d5d44-m6sr5" Jul 23 22:31:40.473517 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:40.473479 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:31:40.583426 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:40.583397 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:31:44.427889 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:44.427861 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-sbdtt" Jul 23 22:31:44.428285 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:44.427932 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5cc6cd444b-9wvrc" Jul 23 22:31:53.618079 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:53.618044 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2dwqb"] Jul 23 22:31:53.621270 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:53.621252 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2dwqb" Jul 23 22:31:53.623674 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:53.623652 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 23 22:31:53.624462 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:53.624437 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-dxxl7\"" Jul 23 22:31:53.624462 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:53.624452 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 23 22:31:53.624636 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:53.624474 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 23 22:31:53.633597 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:53.633569 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2dwqb"] Jul 23 22:31:53.644292 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:53.644225 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:31:53.706682 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:53.706655 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6d4a2d23-155c-4589-a467-75da74093d0b-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2dwqb\" (UID: \"6d4a2d23-155c-4589-a467-75da74093d0b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2dwqb" Jul 23 22:31:53.706806 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:53.706713 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6d4a2d23-155c-4589-a467-75da74093d0b-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2dwqb\" (UID: \"6d4a2d23-155c-4589-a467-75da74093d0b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2dwqb" Jul 23 22:31:53.706806 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:53.706769 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6d4a2d23-155c-4589-a467-75da74093d0b-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2dwqb\" (UID: \"6d4a2d23-155c-4589-a467-75da74093d0b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2dwqb" Jul 23 22:31:53.706806 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:53.706789 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xqb2\" (UniqueName: \"kubernetes.io/projected/6d4a2d23-155c-4589-a467-75da74093d0b-kube-api-access-5xqb2\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2dwqb\" (UID: \"6d4a2d23-155c-4589-a467-75da74093d0b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2dwqb" Jul 23 22:31:53.706959 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:53.706817 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d4a2d23-155c-4589-a467-75da74093d0b-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2dwqb\" (UID: \"6d4a2d23-155c-4589-a467-75da74093d0b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2dwqb" Jul 23 22:31:53.706959 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:53.706850 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6d4a2d23-155c-4589-a467-75da74093d0b-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2dwqb\" (UID: \"6d4a2d23-155c-4589-a467-75da74093d0b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2dwqb" Jul 23 22:31:53.807812 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:53.807778 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6d4a2d23-155c-4589-a467-75da74093d0b-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2dwqb\" (UID: \"6d4a2d23-155c-4589-a467-75da74093d0b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2dwqb" Jul 23 22:31:53.807812 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:53.807816 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6d4a2d23-155c-4589-a467-75da74093d0b-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2dwqb\" (UID: \"6d4a2d23-155c-4589-a467-75da74093d0b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2dwqb" Jul 23 22:31:53.808064 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:53.807835 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xqb2\" (UniqueName: \"kubernetes.io/projected/6d4a2d23-155c-4589-a467-75da74093d0b-kube-api-access-5xqb2\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2dwqb\" (UID: \"6d4a2d23-155c-4589-a467-75da74093d0b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2dwqb" Jul 23 22:31:53.808064 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:53.807853 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d4a2d23-155c-4589-a467-75da74093d0b-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2dwqb\" (UID: \"6d4a2d23-155c-4589-a467-75da74093d0b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2dwqb" Jul 23 22:31:53.808064 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:53.807892 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6d4a2d23-155c-4589-a467-75da74093d0b-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2dwqb\" (UID: \"6d4a2d23-155c-4589-a467-75da74093d0b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2dwqb" Jul 23 22:31:53.808064 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:53.807935 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6d4a2d23-155c-4589-a467-75da74093d0b-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2dwqb\" (UID: \"6d4a2d23-155c-4589-a467-75da74093d0b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2dwqb" Jul 23 22:31:53.808365 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:53.808339 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d4a2d23-155c-4589-a467-75da74093d0b-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2dwqb\" (UID: \"6d4a2d23-155c-4589-a467-75da74093d0b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2dwqb" Jul 23 22:31:53.808416 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:53.808348 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6d4a2d23-155c-4589-a467-75da74093d0b-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2dwqb\" (UID: \"6d4a2d23-155c-4589-a467-75da74093d0b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2dwqb" Jul 23 22:31:53.808416 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:53.808388 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6d4a2d23-155c-4589-a467-75da74093d0b-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2dwqb\" (UID: \"6d4a2d23-155c-4589-a467-75da74093d0b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2dwqb" Jul 23 22:31:53.810051 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:53.810017 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6d4a2d23-155c-4589-a467-75da74093d0b-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2dwqb\" (UID: \"6d4a2d23-155c-4589-a467-75da74093d0b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2dwqb" Jul 23 22:31:53.810378 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:53.810361 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6d4a2d23-155c-4589-a467-75da74093d0b-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2dwqb\" (UID: \"6d4a2d23-155c-4589-a467-75da74093d0b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2dwqb" Jul 23 22:31:53.816377 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:53.816356 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xqb2\" (UniqueName: \"kubernetes.io/projected/6d4a2d23-155c-4589-a467-75da74093d0b-kube-api-access-5xqb2\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2dwqb\" (UID: \"6d4a2d23-155c-4589-a467-75da74093d0b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2dwqb" Jul 23 22:31:53.935401 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:53.935369 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2dwqb" Jul 23 22:31:54.081837 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:54.081798 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2dwqb"] Jul 23 22:31:54.083145 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:31:54.083116 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d4a2d23_155c_4589_a467_75da74093d0b.slice/crio-4fadf44eed3f597b5446a545ba639ab58b41991b5b8a343cabc3c056d0380053 WatchSource:0}: Error finding container 4fadf44eed3f597b5446a545ba639ab58b41991b5b8a343cabc3c056d0380053: Status 404 returned error can't find the container with id 4fadf44eed3f597b5446a545ba639ab58b41991b5b8a343cabc3c056d0380053 Jul 23 22:31:54.552704 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:54.552652 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2dwqb" event={"ID":"6d4a2d23-155c-4589-a467-75da74093d0b","Type":"ContainerStarted","Data":"4fadf44eed3f597b5446a545ba639ab58b41991b5b8a343cabc3c056d0380053"} Jul 23 22:31:55.560784 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:55.560746 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2dwqb" event={"ID":"6d4a2d23-155c-4589-a467-75da74093d0b","Type":"ContainerStarted","Data":"2b068990aa8b3523179f8311e618fc75ed128234ff7110576642e0080a7003ed"} Jul 23 22:31:55.578923 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:31:55.578872 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2dwqb" podStartSLOduration=1.299680873 podStartE2EDuration="2.578829971s" totalImagesPullingTime="1.279149098s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 22:31:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:31:55.577612535 +0000 UTC m=+543.297609821" watchObservedRunningTime="2026-07-23 22:31:55.578829971 +0000 UTC m=+543.298827231" Jul 23 22:32:03.936504 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:32:03.936469 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2dwqb" Jul 23 22:32:03.936990 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:32:03.936563 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2dwqb" Jul 23 22:32:03.952751 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:32:03.952728 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2dwqb" Jul 23 22:32:04.620479 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:32:04.620454 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2dwqb" Jul 23 22:32:17.327696 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:32:17.327663 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:32:17.411877 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:32:17.411847 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:32:28.001200 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:32:28.001168 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-dvnb2"] Jul 23 22:32:28.003844 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:32:28.003826 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dvnb2" Jul 23 22:32:28.006860 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:32:28.006843 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 23 22:32:28.016811 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:32:28.016791 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-dvnb2"] Jul 23 22:32:28.018529 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:32:28.018506 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:32:28.097449 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:32:28.097425 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdqch\" (UniqueName: \"kubernetes.io/projected/9989ccdb-51b5-4470-b8b7-4aed482811c7-kube-api-access-fdqch\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dvnb2\" (UID: \"9989ccdb-51b5-4470-b8b7-4aed482811c7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dvnb2" Jul 23 22:32:28.097555 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:32:28.097458 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9989ccdb-51b5-4470-b8b7-4aed482811c7-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dvnb2\" (UID: \"9989ccdb-51b5-4470-b8b7-4aed482811c7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dvnb2" Jul 23 22:32:28.097555 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:32:28.097513 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9989ccdb-51b5-4470-b8b7-4aed482811c7-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dvnb2\" (UID: \"9989ccdb-51b5-4470-b8b7-4aed482811c7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dvnb2" Jul 23 22:32:28.097634 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:32:28.097554 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9989ccdb-51b5-4470-b8b7-4aed482811c7-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dvnb2\" (UID: \"9989ccdb-51b5-4470-b8b7-4aed482811c7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dvnb2" Jul 23 22:32:28.097634 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:32:28.097613 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9989ccdb-51b5-4470-b8b7-4aed482811c7-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dvnb2\" (UID: \"9989ccdb-51b5-4470-b8b7-4aed482811c7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dvnb2" Jul 23 22:32:28.097699 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:32:28.097656 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9989ccdb-51b5-4470-b8b7-4aed482811c7-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dvnb2\" (UID: \"9989ccdb-51b5-4470-b8b7-4aed482811c7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dvnb2" Jul 23 22:32:28.198450 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:32:28.198425 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9989ccdb-51b5-4470-b8b7-4aed482811c7-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dvnb2\" (UID: \"9989ccdb-51b5-4470-b8b7-4aed482811c7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dvnb2" Jul 23 22:32:28.198450 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:32:28.198460 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9989ccdb-51b5-4470-b8b7-4aed482811c7-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dvnb2\" (UID: \"9989ccdb-51b5-4470-b8b7-4aed482811c7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dvnb2" Jul 23 22:32:28.198647 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:32:28.198483 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9989ccdb-51b5-4470-b8b7-4aed482811c7-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dvnb2\" (UID: \"9989ccdb-51b5-4470-b8b7-4aed482811c7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dvnb2" Jul 23 22:32:28.198647 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:32:28.198508 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdqch\" (UniqueName: \"kubernetes.io/projected/9989ccdb-51b5-4470-b8b7-4aed482811c7-kube-api-access-fdqch\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dvnb2\" (UID: \"9989ccdb-51b5-4470-b8b7-4aed482811c7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dvnb2" Jul 23 22:32:28.198647 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:32:28.198569 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9989ccdb-51b5-4470-b8b7-4aed482811c7-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dvnb2\" (UID: \"9989ccdb-51b5-4470-b8b7-4aed482811c7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dvnb2" Jul 23 22:32:28.198647 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:32:28.198639 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9989ccdb-51b5-4470-b8b7-4aed482811c7-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dvnb2\" (UID: \"9989ccdb-51b5-4470-b8b7-4aed482811c7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dvnb2" Jul 23 22:32:28.198953 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:32:28.198925 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9989ccdb-51b5-4470-b8b7-4aed482811c7-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dvnb2\" (UID: \"9989ccdb-51b5-4470-b8b7-4aed482811c7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dvnb2" Jul 23 22:32:28.199052 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:32:28.198968 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9989ccdb-51b5-4470-b8b7-4aed482811c7-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dvnb2\" (UID: \"9989ccdb-51b5-4470-b8b7-4aed482811c7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dvnb2" Jul 23 22:32:28.199052 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:32:28.199010 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9989ccdb-51b5-4470-b8b7-4aed482811c7-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dvnb2\" (UID: \"9989ccdb-51b5-4470-b8b7-4aed482811c7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dvnb2" Jul 23 22:32:28.200854 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:32:28.200836 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9989ccdb-51b5-4470-b8b7-4aed482811c7-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dvnb2\" (UID: \"9989ccdb-51b5-4470-b8b7-4aed482811c7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dvnb2" Jul 23 22:32:28.200998 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:32:28.200980 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9989ccdb-51b5-4470-b8b7-4aed482811c7-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dvnb2\" (UID: \"9989ccdb-51b5-4470-b8b7-4aed482811c7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dvnb2" Jul 23 22:32:28.208474 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:32:28.208451 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdqch\" (UniqueName: \"kubernetes.io/projected/9989ccdb-51b5-4470-b8b7-4aed482811c7-kube-api-access-fdqch\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dvnb2\" (UID: \"9989ccdb-51b5-4470-b8b7-4aed482811c7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dvnb2" Jul 23 22:32:28.313470 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:32:28.313415 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dvnb2" Jul 23 22:32:28.446521 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:32:28.446494 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-dvnb2"] Jul 23 22:32:28.447997 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:32:28.447962 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9989ccdb_51b5_4470_b8b7_4aed482811c7.slice/crio-f7d7364f74fbe0c2835d0c8d6724cbb4fd907ad7acd8d8b60b013ba345f54e99 WatchSource:0}: Error finding container f7d7364f74fbe0c2835d0c8d6724cbb4fd907ad7acd8d8b60b013ba345f54e99: Status 404 returned error can't find the container with id f7d7364f74fbe0c2835d0c8d6724cbb4fd907ad7acd8d8b60b013ba345f54e99 Jul 23 22:32:28.752623 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:32:28.752585 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dvnb2" event={"ID":"9989ccdb-51b5-4470-b8b7-4aed482811c7","Type":"ContainerStarted","Data":"cc9fa50fa550045e3cf46c78e464d2e771a5b46dc05fd5c3f810295fe32e3bda"} Jul 23 22:32:28.752753 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:32:28.752648 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dvnb2" event={"ID":"9989ccdb-51b5-4470-b8b7-4aed482811c7","Type":"ContainerStarted","Data":"f7d7364f74fbe0c2835d0c8d6724cbb4fd907ad7acd8d8b60b013ba345f54e99"} Jul 23 22:32:28.774110 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:32:28.774067 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dvnb2" podStartSLOduration=1.5707107869999999 podStartE2EDuration="1.774052366s" totalImagesPullingTime="203.341579ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 22:32:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:32:28.770582848 +0000 UTC m=+576.490580136" watchObservedRunningTime="2026-07-23 22:32:28.774052366 +0000 UTC m=+576.494049641" Jul 23 22:32:35.828268 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:32:35.828224 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:32:38.313977 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:32:38.313940 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dvnb2" Jul 23 22:32:38.314392 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:32:38.313995 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dvnb2" Jul 23 22:32:38.327068 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:32:38.327010 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dvnb2" Jul 23 22:32:38.821711 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:32:38.821681 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dvnb2" Jul 23 22:32:52.710919 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:32:52.710886 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-wbwxj"] Jul 23 22:32:52.713956 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:32:52.713932 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wbwxj" Jul 23 22:32:52.716334 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:32:52.716314 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 23 22:32:52.725659 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:32:52.725633 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-wbwxj"] Jul 23 22:32:52.735553 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:32:52.735532 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:32:52.781670 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:32:52.781601 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f5040122-e952-47e4-9cb5-707d4b6ff52f-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wbwxj\" (UID: \"f5040122-e952-47e4-9cb5-707d4b6ff52f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wbwxj" Jul 23 22:32:52.781670 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:32:52.781661 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f5040122-e952-47e4-9cb5-707d4b6ff52f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wbwxj\" (UID: \"f5040122-e952-47e4-9cb5-707d4b6ff52f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wbwxj" Jul 23 22:32:52.781847 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:32:52.781695 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f5040122-e952-47e4-9cb5-707d4b6ff52f-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wbwxj\" (UID: \"f5040122-e952-47e4-9cb5-707d4b6ff52f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wbwxj" Jul 23 22:32:52.781847 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:32:52.781734 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f5040122-e952-47e4-9cb5-707d4b6ff52f-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wbwxj\" (UID: \"f5040122-e952-47e4-9cb5-707d4b6ff52f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wbwxj" Jul 23 22:32:52.781847 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:32:52.781769 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f5040122-e952-47e4-9cb5-707d4b6ff52f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wbwxj\" (UID: \"f5040122-e952-47e4-9cb5-707d4b6ff52f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wbwxj" Jul 23 22:32:52.781847 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:32:52.781791 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lq8sp\" (UniqueName: \"kubernetes.io/projected/f5040122-e952-47e4-9cb5-707d4b6ff52f-kube-api-access-lq8sp\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wbwxj\" (UID: \"f5040122-e952-47e4-9cb5-707d4b6ff52f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wbwxj" Jul 23 22:32:52.882307 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:32:52.882274 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f5040122-e952-47e4-9cb5-707d4b6ff52f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wbwxj\" (UID: \"f5040122-e952-47e4-9cb5-707d4b6ff52f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wbwxj" Jul 23 22:32:52.882458 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:32:52.882321 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f5040122-e952-47e4-9cb5-707d4b6ff52f-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wbwxj\" (UID: \"f5040122-e952-47e4-9cb5-707d4b6ff52f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wbwxj" Jul 23 22:32:52.882458 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:32:52.882381 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f5040122-e952-47e4-9cb5-707d4b6ff52f-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wbwxj\" (UID: \"f5040122-e952-47e4-9cb5-707d4b6ff52f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wbwxj" Jul 23 22:32:52.882458 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:32:52.882449 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f5040122-e952-47e4-9cb5-707d4b6ff52f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wbwxj\" (UID: \"f5040122-e952-47e4-9cb5-707d4b6ff52f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wbwxj" Jul 23 22:32:52.882613 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:32:52.882475 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lq8sp\" (UniqueName: \"kubernetes.io/projected/f5040122-e952-47e4-9cb5-707d4b6ff52f-kube-api-access-lq8sp\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wbwxj\" (UID: \"f5040122-e952-47e4-9cb5-707d4b6ff52f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wbwxj" Jul 23 22:32:52.882613 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:32:52.882539 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f5040122-e952-47e4-9cb5-707d4b6ff52f-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wbwxj\" (UID: \"f5040122-e952-47e4-9cb5-707d4b6ff52f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wbwxj" Jul 23 22:32:52.882784 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:32:52.882763 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f5040122-e952-47e4-9cb5-707d4b6ff52f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wbwxj\" (UID: \"f5040122-e952-47e4-9cb5-707d4b6ff52f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wbwxj" Jul 23 22:32:52.882846 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:32:52.882836 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f5040122-e952-47e4-9cb5-707d4b6ff52f-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wbwxj\" (UID: \"f5040122-e952-47e4-9cb5-707d4b6ff52f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wbwxj" Jul 23 22:32:52.883103 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:32:52.883078 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f5040122-e952-47e4-9cb5-707d4b6ff52f-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wbwxj\" (UID: \"f5040122-e952-47e4-9cb5-707d4b6ff52f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wbwxj" Jul 23 22:32:52.885173 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:32:52.885153 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f5040122-e952-47e4-9cb5-707d4b6ff52f-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wbwxj\" (UID: \"f5040122-e952-47e4-9cb5-707d4b6ff52f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wbwxj" Jul 23 22:32:52.885621 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:32:52.885603 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f5040122-e952-47e4-9cb5-707d4b6ff52f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wbwxj\" (UID: \"f5040122-e952-47e4-9cb5-707d4b6ff52f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wbwxj" Jul 23 22:32:52.891288 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:32:52.891267 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lq8sp\" (UniqueName: \"kubernetes.io/projected/f5040122-e952-47e4-9cb5-707d4b6ff52f-kube-api-access-lq8sp\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wbwxj\" (UID: \"f5040122-e952-47e4-9cb5-707d4b6ff52f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wbwxj" Jul 23 22:32:53.027483 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:32:53.027431 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wbwxj" Jul 23 22:32:53.157618 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:32:53.157585 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-wbwxj"] Jul 23 22:32:53.158926 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:32:53.158893 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5040122_e952_47e4_9cb5_707d4b6ff52f.slice/crio-51e84cff4907ae53cdb0631b0ae3cb6e54c6db9dbbc0db65cff0a3c5d9d9d6a0 WatchSource:0}: Error finding container 51e84cff4907ae53cdb0631b0ae3cb6e54c6db9dbbc0db65cff0a3c5d9d9d6a0: Status 404 returned error can't find the container with id 51e84cff4907ae53cdb0631b0ae3cb6e54c6db9dbbc0db65cff0a3c5d9d9d6a0 Jul 23 22:32:53.892622 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:32:53.892588 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wbwxj" event={"ID":"f5040122-e952-47e4-9cb5-707d4b6ff52f","Type":"ContainerStarted","Data":"f70e2a786e35a7862abca6271e1466c593aea7bb2307c6c41c2c1a686ce1fea0"} Jul 23 22:32:53.893071 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:32:53.892641 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wbwxj" event={"ID":"f5040122-e952-47e4-9cb5-707d4b6ff52f","Type":"ContainerStarted","Data":"51e84cff4907ae53cdb0631b0ae3cb6e54c6db9dbbc0db65cff0a3c5d9d9d6a0"} Jul 23 22:32:53.911437 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:32:53.911387 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wbwxj" podStartSLOduration=1.7444247210000001 podStartE2EDuration="1.911372509s" totalImagesPullingTime="166.947788ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 22:32:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:32:53.910862296 +0000 UTC m=+601.630859556" watchObservedRunningTime="2026-07-23 22:32:53.911372509 +0000 UTC m=+601.631369769" Jul 23 22:33:00.731525 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:33:00.731474 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:33:03.027813 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:33:03.027765 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wbwxj" Jul 23 22:33:03.028255 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:33:03.027847 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wbwxj" Jul 23 22:33:03.045662 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:33:03.045631 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wbwxj" Jul 23 22:33:03.958804 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:33:03.958775 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wbwxj" Jul 23 22:33:48.351955 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:33:48.351921 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-594fc54f5c-7qfnr"] Jul 23 22:33:48.356641 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:33:48.356605 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-594fc54f5c-7qfnr" Jul 23 22:33:48.364395 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:33:48.364362 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-594fc54f5c-7qfnr"] Jul 23 22:33:48.527703 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:33:48.527679 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a6e2c76e-d71c-4952-b4a2-d562d803910a-tls-cert\") pod \"authorino-594fc54f5c-7qfnr\" (UID: \"a6e2c76e-d71c-4952-b4a2-d562d803910a\") " pod="kuadrant-system/authorino-594fc54f5c-7qfnr" Jul 23 22:33:48.527808 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:33:48.527708 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjw45\" (UniqueName: \"kubernetes.io/projected/a6e2c76e-d71c-4952-b4a2-d562d803910a-kube-api-access-pjw45\") pod \"authorino-594fc54f5c-7qfnr\" (UID: \"a6e2c76e-d71c-4952-b4a2-d562d803910a\") " pod="kuadrant-system/authorino-594fc54f5c-7qfnr" Jul 23 22:33:48.629004 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:33:48.628947 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a6e2c76e-d71c-4952-b4a2-d562d803910a-tls-cert\") pod \"authorino-594fc54f5c-7qfnr\" (UID: \"a6e2c76e-d71c-4952-b4a2-d562d803910a\") " pod="kuadrant-system/authorino-594fc54f5c-7qfnr" Jul 23 22:33:48.629004 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:33:48.628976 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjw45\" (UniqueName: \"kubernetes.io/projected/a6e2c76e-d71c-4952-b4a2-d562d803910a-kube-api-access-pjw45\") pod \"authorino-594fc54f5c-7qfnr\" (UID: \"a6e2c76e-d71c-4952-b4a2-d562d803910a\") " pod="kuadrant-system/authorino-594fc54f5c-7qfnr" Jul 23 22:33:48.631199 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:33:48.631178 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a6e2c76e-d71c-4952-b4a2-d562d803910a-tls-cert\") pod \"authorino-594fc54f5c-7qfnr\" (UID: \"a6e2c76e-d71c-4952-b4a2-d562d803910a\") " pod="kuadrant-system/authorino-594fc54f5c-7qfnr" Jul 23 22:33:48.636290 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:33:48.636270 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjw45\" (UniqueName: \"kubernetes.io/projected/a6e2c76e-d71c-4952-b4a2-d562d803910a-kube-api-access-pjw45\") pod \"authorino-594fc54f5c-7qfnr\" (UID: \"a6e2c76e-d71c-4952-b4a2-d562d803910a\") " pod="kuadrant-system/authorino-594fc54f5c-7qfnr" Jul 23 22:33:48.671239 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:33:48.671222 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-594fc54f5c-7qfnr" Jul 23 22:33:48.704885 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:33:48.704859 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:33:48.812966 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:33:48.812925 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-594fc54f5c-7qfnr"] Jul 23 22:33:48.813965 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:33:48.813943 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:33:48.816667 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:33:48.816644 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda6e2c76e_d71c_4952_b4a2_d562d803910a.slice/crio-48bb2955cb57c3d3f864a4a3ff687369d229ad280899a6691b98fbf6c67bfce8 WatchSource:0}: Error finding container 48bb2955cb57c3d3f864a4a3ff687369d229ad280899a6691b98fbf6c67bfce8: Status 404 returned error can't find the container with id 48bb2955cb57c3d3f864a4a3ff687369d229ad280899a6691b98fbf6c67bfce8 Jul 23 22:33:48.818185 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:33:48.818169 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 23 22:33:49.186948 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:33:49.186916 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-594fc54f5c-7qfnr" event={"ID":"a6e2c76e-d71c-4952-b4a2-d562d803910a","Type":"ContainerStarted","Data":"48bb2955cb57c3d3f864a4a3ff687369d229ad280899a6691b98fbf6c67bfce8"} Jul 23 22:33:49.960170 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:33:49.960124 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:33:50.054850 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:33:50.054784 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:33:50.194975 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:33:50.194934 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-594fc54f5c-7qfnr" event={"ID":"a6e2c76e-d71c-4952-b4a2-d562d803910a","Type":"ContainerStarted","Data":"d0f53365b69c1986e1f80e478619d59ab0c238953b7c220cbc5ba55b0dd64d7f"} Jul 23 22:33:50.219531 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:33:50.219427 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-594fc54f5c-7qfnr" podStartSLOduration=1.587238545 podStartE2EDuration="2.219407755s" totalImagesPullingTime="632.16921ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 22:33:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:33:50.214805299 +0000 UTC m=+657.934802560" watchObservedRunningTime="2026-07-23 22:33:50.219407755 +0000 UTC m=+657.939405017" Jul 23 22:33:50.271458 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:33:50.271422 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6667d9f684-nprbd"] Jul 23 22:33:50.271697 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:33:50.271670 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-6667d9f684-nprbd" podUID="f4f00035-5ade-45dd-b277-c9edf696e309" containerName="authorino" containerID="cri-o://1f650d4e6e369128f68aea0047befb2cd287a7d91507a683f98d4053c42f41de" gracePeriod=30 Jul 23 22:33:50.523313 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:33:50.523290 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6667d9f684-nprbd" Jul 23 22:33:50.649066 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:33:50.649015 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f4f00035-5ade-45dd-b277-c9edf696e309-tls-cert\") pod \"f4f00035-5ade-45dd-b277-c9edf696e309\" (UID: \"f4f00035-5ade-45dd-b277-c9edf696e309\") " Jul 23 22:33:50.649221 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:33:50.649175 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2lqp2\" (UniqueName: \"kubernetes.io/projected/f4f00035-5ade-45dd-b277-c9edf696e309-kube-api-access-2lqp2\") pod \"f4f00035-5ade-45dd-b277-c9edf696e309\" (UID: \"f4f00035-5ade-45dd-b277-c9edf696e309\") " Jul 23 22:33:50.651277 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:33:50.651230 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4f00035-5ade-45dd-b277-c9edf696e309-kube-api-access-2lqp2" (OuterVolumeSpecName: "kube-api-access-2lqp2") pod "f4f00035-5ade-45dd-b277-c9edf696e309" (UID: "f4f00035-5ade-45dd-b277-c9edf696e309"). InnerVolumeSpecName "kube-api-access-2lqp2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 22:33:50.661427 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:33:50.661402 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4f00035-5ade-45dd-b277-c9edf696e309-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "f4f00035-5ade-45dd-b277-c9edf696e309" (UID: "f4f00035-5ade-45dd-b277-c9edf696e309"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 22:33:50.750816 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:33:50.750782 2575 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f4f00035-5ade-45dd-b277-c9edf696e309-tls-cert\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 22:33:50.750816 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:33:50.750815 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2lqp2\" (UniqueName: \"kubernetes.io/projected/f4f00035-5ade-45dd-b277-c9edf696e309-kube-api-access-2lqp2\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 22:33:51.204803 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:33:51.204768 2575 generic.go:356] "Generic (PLEG): container finished" podID="f4f00035-5ade-45dd-b277-c9edf696e309" containerID="1f650d4e6e369128f68aea0047befb2cd287a7d91507a683f98d4053c42f41de" exitCode=0 Jul 23 22:33:51.205955 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:33:51.205932 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6667d9f684-nprbd" Jul 23 22:33:51.206583 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:33:51.206564 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6667d9f684-nprbd" event={"ID":"f4f00035-5ade-45dd-b277-c9edf696e309","Type":"ContainerDied","Data":"1f650d4e6e369128f68aea0047befb2cd287a7d91507a683f98d4053c42f41de"} Jul 23 22:33:51.206727 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:33:51.206713 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6667d9f684-nprbd" event={"ID":"f4f00035-5ade-45dd-b277-c9edf696e309","Type":"ContainerDied","Data":"42d057407712695e7a11f299311089a55a0b383a207e0c20bff1127511a330a9"} Jul 23 22:33:51.206814 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:33:51.206804 2575 scope.go:117] "RemoveContainer" containerID="1f650d4e6e369128f68aea0047befb2cd287a7d91507a683f98d4053c42f41de" Jul 23 22:33:51.218957 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:33:51.218928 2575 scope.go:117] "RemoveContainer" containerID="1f650d4e6e369128f68aea0047befb2cd287a7d91507a683f98d4053c42f41de" Jul 23 22:33:51.219235 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:33:51.219214 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f650d4e6e369128f68aea0047befb2cd287a7d91507a683f98d4053c42f41de\": container with ID starting with 1f650d4e6e369128f68aea0047befb2cd287a7d91507a683f98d4053c42f41de not found: ID does not exist" containerID="1f650d4e6e369128f68aea0047befb2cd287a7d91507a683f98d4053c42f41de" Jul 23 22:33:51.219312 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:33:51.219249 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f650d4e6e369128f68aea0047befb2cd287a7d91507a683f98d4053c42f41de"} err="failed to get container status \"1f650d4e6e369128f68aea0047befb2cd287a7d91507a683f98d4053c42f41de\": rpc error: code = NotFound desc = could not find container \"1f650d4e6e369128f68aea0047befb2cd287a7d91507a683f98d4053c42f41de\": container with ID starting with 1f650d4e6e369128f68aea0047befb2cd287a7d91507a683f98d4053c42f41de not found: ID does not exist" Jul 23 22:33:51.231618 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:33:51.231593 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6667d9f684-nprbd"] Jul 23 22:33:51.234587 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:33:51.234566 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6667d9f684-nprbd"] Jul 23 22:33:52.814247 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:33:52.814217 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4f00035-5ade-45dd-b277-c9edf696e309" path="/var/lib/kubelet/pods/f4f00035-5ade-45dd-b277-c9edf696e309/volumes" Jul 23 22:34:00.351372 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:34:00.351338 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:34:02.357501 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:34:02.357462 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:34:36.682864 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:34:36.682828 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7845c898b6-x29w9"] Jul 23 22:34:36.683501 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:34:36.683056 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7845c898b6-x29w9" podUID="e74b6a97-3719-46c6-b17d-d66bd1472054" containerName="manager" containerID="cri-o://19b3030ee2020a8d7601389ecab058c3da5babfada6fd5008fad562cb0aa8756" gracePeriod=30 Jul 23 22:34:36.938700 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:34:36.938645 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7845c898b6-x29w9" Jul 23 22:34:37.039882 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:34:37.039849 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e74b6a97-3719-46c6-b17d-d66bd1472054-webhook-cert\") pod \"e74b6a97-3719-46c6-b17d-d66bd1472054\" (UID: \"e74b6a97-3719-46c6-b17d-d66bd1472054\") " Jul 23 22:34:37.040078 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:34:37.039913 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9k9gb\" (UniqueName: \"kubernetes.io/projected/e74b6a97-3719-46c6-b17d-d66bd1472054-kube-api-access-9k9gb\") pod \"e74b6a97-3719-46c6-b17d-d66bd1472054\" (UID: \"e74b6a97-3719-46c6-b17d-d66bd1472054\") " Jul 23 22:34:37.041981 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:34:37.041955 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e74b6a97-3719-46c6-b17d-d66bd1472054-kube-api-access-9k9gb" (OuterVolumeSpecName: "kube-api-access-9k9gb") pod "e74b6a97-3719-46c6-b17d-d66bd1472054" (UID: "e74b6a97-3719-46c6-b17d-d66bd1472054"). InnerVolumeSpecName "kube-api-access-9k9gb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 22:34:37.042109 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:34:37.041991 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e74b6a97-3719-46c6-b17d-d66bd1472054-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "e74b6a97-3719-46c6-b17d-d66bd1472054" (UID: "e74b6a97-3719-46c6-b17d-d66bd1472054"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 22:34:37.140836 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:34:37.140807 2575 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e74b6a97-3719-46c6-b17d-d66bd1472054-webhook-cert\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 22:34:37.140836 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:34:37.140833 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9k9gb\" (UniqueName: \"kubernetes.io/projected/e74b6a97-3719-46c6-b17d-d66bd1472054-kube-api-access-9k9gb\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 22:34:37.478450 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:34:37.478419 2575 generic.go:356] "Generic (PLEG): container finished" podID="e74b6a97-3719-46c6-b17d-d66bd1472054" containerID="19b3030ee2020a8d7601389ecab058c3da5babfada6fd5008fad562cb0aa8756" exitCode=0 Jul 23 22:34:37.478621 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:34:37.478459 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7845c898b6-x29w9" Jul 23 22:34:37.478621 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:34:37.478471 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7845c898b6-x29w9" event={"ID":"e74b6a97-3719-46c6-b17d-d66bd1472054","Type":"ContainerDied","Data":"19b3030ee2020a8d7601389ecab058c3da5babfada6fd5008fad562cb0aa8756"} Jul 23 22:34:37.478621 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:34:37.478518 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7845c898b6-x29w9" event={"ID":"e74b6a97-3719-46c6-b17d-d66bd1472054","Type":"ContainerDied","Data":"7b4eefcba82e0d38a0c940b324430ecffad34e36456e33d4c6f4fd5f28ba1cae"} Jul 23 22:34:37.478621 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:34:37.478540 2575 scope.go:117] "RemoveContainer" containerID="19b3030ee2020a8d7601389ecab058c3da5babfada6fd5008fad562cb0aa8756" Jul 23 22:34:37.488255 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:34:37.488239 2575 scope.go:117] "RemoveContainer" containerID="19b3030ee2020a8d7601389ecab058c3da5babfada6fd5008fad562cb0aa8756" Jul 23 22:34:37.488485 ip-10-0-134-206 kubenswrapper[2575]: E0723 22:34:37.488466 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19b3030ee2020a8d7601389ecab058c3da5babfada6fd5008fad562cb0aa8756\": container with ID starting with 19b3030ee2020a8d7601389ecab058c3da5babfada6fd5008fad562cb0aa8756 not found: ID does not exist" containerID="19b3030ee2020a8d7601389ecab058c3da5babfada6fd5008fad562cb0aa8756" Jul 23 22:34:37.488546 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:34:37.488491 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19b3030ee2020a8d7601389ecab058c3da5babfada6fd5008fad562cb0aa8756"} err="failed to get container status \"19b3030ee2020a8d7601389ecab058c3da5babfada6fd5008fad562cb0aa8756\": rpc error: code = NotFound desc = could not find container \"19b3030ee2020a8d7601389ecab058c3da5babfada6fd5008fad562cb0aa8756\": container with ID starting with 19b3030ee2020a8d7601389ecab058c3da5babfada6fd5008fad562cb0aa8756 not found: ID does not exist" Jul 23 22:34:37.501400 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:34:37.501355 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7845c898b6-x29w9"] Jul 23 22:34:37.504948 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:34:37.504926 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7845c898b6-x29w9"] Jul 23 22:34:38.807649 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:34:38.807602 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e74b6a97-3719-46c6-b17d-d66bd1472054" path="/var/lib/kubelet/pods/e74b6a97-3719-46c6-b17d-d66bd1472054/volumes" Jul 23 22:35:46.098586 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:35:46.098551 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:35:52.797648 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:35:52.797609 2575 scope.go:117] "RemoveContainer" containerID="49627f8a2777f2f08ce61d7c2af479952033bbfb0b65119f2bb4c3af10f03afd" Jul 23 22:35:57.315567 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:35:57.315522 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:35:58.876139 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:35:58.876107 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:36:33.198676 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:36:33.198637 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:36:33.286998 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:36:33.286966 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:36:33.426263 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:36:33.426233 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:36:39.744773 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:36:39.744738 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:36:39.810481 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:36:39.810452 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:36:39.912082 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:36:39.912044 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:36:39.991997 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:36:39.991955 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:36:40.128188 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:36:40.128096 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:36:46.284062 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:36:46.284005 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:36:46.338939 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:36:46.338907 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:37:39.958710 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:37:39.958675 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:39:43.513942 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:39:43.513863 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:39:43.596789 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:39:43.596745 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:40:37.808440 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:40:37.808407 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2shqm"] Jul 23 22:40:37.809326 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:40:37.809273 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2shqm" podUID="363fef20-5826-4a06-9d3c-2dfebafcebaa" containerName="manager" containerID="cri-o://14177d4300d5d7a435fe5d5ad690d6040ab95fc280022f4e72c3f42d22b3eb3c" gracePeriod=10 Jul 23 22:40:41.548351 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:40:41.548320 2575 generic.go:356] "Generic (PLEG): container finished" podID="363fef20-5826-4a06-9d3c-2dfebafcebaa" containerID="14177d4300d5d7a435fe5d5ad690d6040ab95fc280022f4e72c3f42d22b3eb3c" exitCode=0 Jul 23 22:40:41.548656 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:40:41.548393 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2shqm" event={"ID":"363fef20-5826-4a06-9d3c-2dfebafcebaa","Type":"ContainerDied","Data":"14177d4300d5d7a435fe5d5ad690d6040ab95fc280022f4e72c3f42d22b3eb3c"} Jul 23 22:40:41.662441 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:40:41.662415 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2shqm" Jul 23 22:40:41.763498 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:40:41.763474 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pr669\" (UniqueName: \"kubernetes.io/projected/363fef20-5826-4a06-9d3c-2dfebafcebaa-kube-api-access-pr669\") pod \"363fef20-5826-4a06-9d3c-2dfebafcebaa\" (UID: \"363fef20-5826-4a06-9d3c-2dfebafcebaa\") " Jul 23 22:40:41.763642 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:40:41.763605 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/363fef20-5826-4a06-9d3c-2dfebafcebaa-extensions-socket-volume\") pod \"363fef20-5826-4a06-9d3c-2dfebafcebaa\" (UID: \"363fef20-5826-4a06-9d3c-2dfebafcebaa\") " Jul 23 22:40:41.763941 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:40:41.763920 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/363fef20-5826-4a06-9d3c-2dfebafcebaa-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "363fef20-5826-4a06-9d3c-2dfebafcebaa" (UID: "363fef20-5826-4a06-9d3c-2dfebafcebaa"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 22:40:41.765369 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:40:41.765352 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/363fef20-5826-4a06-9d3c-2dfebafcebaa-kube-api-access-pr669" (OuterVolumeSpecName: "kube-api-access-pr669") pod "363fef20-5826-4a06-9d3c-2dfebafcebaa" (UID: "363fef20-5826-4a06-9d3c-2dfebafcebaa"). InnerVolumeSpecName "kube-api-access-pr669". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 22:40:41.864906 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:40:41.864855 2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/363fef20-5826-4a06-9d3c-2dfebafcebaa-extensions-socket-volume\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 22:40:41.864906 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:40:41.864874 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pr669\" (UniqueName: \"kubernetes.io/projected/363fef20-5826-4a06-9d3c-2dfebafcebaa-kube-api-access-pr669\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 22:40:42.554619 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:40:42.554596 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2shqm" Jul 23 22:40:42.554956 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:40:42.554639 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2shqm" event={"ID":"363fef20-5826-4a06-9d3c-2dfebafcebaa","Type":"ContainerDied","Data":"e188c3fce909e5337264c02167a79e6e944aa3a4f668b60af5a60876facb0b1c"} Jul 23 22:40:42.554956 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:40:42.554696 2575 scope.go:117] "RemoveContainer" containerID="14177d4300d5d7a435fe5d5ad690d6040ab95fc280022f4e72c3f42d22b3eb3c" Jul 23 22:40:42.577153 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:40:42.577129 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2shqm"] Jul 23 22:40:42.581058 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:40:42.581038 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2shqm"] Jul 23 22:40:42.807357 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:40:42.807309 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="363fef20-5826-4a06-9d3c-2dfebafcebaa" path="/var/lib/kubelet/pods/363fef20-5826-4a06-9d3c-2dfebafcebaa/volumes" Jul 23 22:41:36.092441 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:41:36.092405 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:41:36.147451 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:41:36.147425 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:41:38.947770 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:41:38.947726 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bjnr6"] Jul 23 22:41:38.948314 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:41:38.948293 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4f00035-5ade-45dd-b277-c9edf696e309" containerName="authorino" Jul 23 22:41:38.948314 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:41:38.948315 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4f00035-5ade-45dd-b277-c9edf696e309" containerName="authorino" Jul 23 22:41:38.948455 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:41:38.948330 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="363fef20-5826-4a06-9d3c-2dfebafcebaa" containerName="manager" Jul 23 22:41:38.948455 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:41:38.948337 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="363fef20-5826-4a06-9d3c-2dfebafcebaa" containerName="manager" Jul 23 22:41:38.948455 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:41:38.948377 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e74b6a97-3719-46c6-b17d-d66bd1472054" containerName="manager" Jul 23 22:41:38.948455 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:41:38.948385 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e74b6a97-3719-46c6-b17d-d66bd1472054" containerName="manager" Jul 23 22:41:38.948643 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:41:38.948479 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4f00035-5ade-45dd-b277-c9edf696e309" containerName="authorino" Jul 23 22:41:38.948643 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:41:38.948494 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e74b6a97-3719-46c6-b17d-d66bd1472054" containerName="manager" Jul 23 22:41:38.948643 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:41:38.948504 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="363fef20-5826-4a06-9d3c-2dfebafcebaa" containerName="manager" Jul 23 22:41:38.951597 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:41:38.951577 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bjnr6" Jul 23 22:41:38.954090 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:41:38.954073 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-2llnx\"" Jul 23 22:41:38.963951 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:41:38.963929 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bjnr6"] Jul 23 22:41:39.003988 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:41:39.003967 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd13ddfa-7299-4ac5-818c-f497901eb449-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-bjnr6\" (UID: \"fd13ddfa-7299-4ac5-818c-f497901eb449\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bjnr6" Jul 23 22:41:39.004087 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:41:39.004003 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmjsl\" (UniqueName: \"kubernetes.io/projected/fd13ddfa-7299-4ac5-818c-f497901eb449-kube-api-access-zmjsl\") pod \"kuadrant-operator-controller-manager-86878c769f-bjnr6\" (UID: \"fd13ddfa-7299-4ac5-818c-f497901eb449\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bjnr6" Jul 23 22:41:39.105126 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:41:39.105104 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd13ddfa-7299-4ac5-818c-f497901eb449-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-bjnr6\" (UID: \"fd13ddfa-7299-4ac5-818c-f497901eb449\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bjnr6" Jul 23 22:41:39.105239 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:41:39.105141 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmjsl\" (UniqueName: \"kubernetes.io/projected/fd13ddfa-7299-4ac5-818c-f497901eb449-kube-api-access-zmjsl\") pod \"kuadrant-operator-controller-manager-86878c769f-bjnr6\" (UID: \"fd13ddfa-7299-4ac5-818c-f497901eb449\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bjnr6" Jul 23 22:41:39.105484 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:41:39.105454 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd13ddfa-7299-4ac5-818c-f497901eb449-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-bjnr6\" (UID: \"fd13ddfa-7299-4ac5-818c-f497901eb449\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bjnr6" Jul 23 22:41:39.114720 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:41:39.114697 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmjsl\" (UniqueName: \"kubernetes.io/projected/fd13ddfa-7299-4ac5-818c-f497901eb449-kube-api-access-zmjsl\") pod \"kuadrant-operator-controller-manager-86878c769f-bjnr6\" (UID: \"fd13ddfa-7299-4ac5-818c-f497901eb449\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bjnr6" Jul 23 22:41:39.260758 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:41:39.260693 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bjnr6" Jul 23 22:41:39.394138 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:41:39.394114 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bjnr6"] Jul 23 22:41:39.395833 ip-10-0-134-206 kubenswrapper[2575]: W0723 22:41:39.395809 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd13ddfa_7299_4ac5_818c_f497901eb449.slice/crio-340630013a93b2efb882ee8dc5965661728f3b1f11513ff77da1900004f2f561 WatchSource:0}: Error finding container 340630013a93b2efb882ee8dc5965661728f3b1f11513ff77da1900004f2f561: Status 404 returned error can't find the container with id 340630013a93b2efb882ee8dc5965661728f3b1f11513ff77da1900004f2f561 Jul 23 22:41:39.851436 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:41:39.851401 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bjnr6" event={"ID":"fd13ddfa-7299-4ac5-818c-f497901eb449","Type":"ContainerStarted","Data":"2be1c4ffcbfe67e75ada23d54ebab6de8a7639182244e50e9c35de64ffae62c3"} Jul 23 22:41:39.851633 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:41:39.851451 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bjnr6" event={"ID":"fd13ddfa-7299-4ac5-818c-f497901eb449","Type":"ContainerStarted","Data":"340630013a93b2efb882ee8dc5965661728f3b1f11513ff77da1900004f2f561"} Jul 23 22:41:39.851633 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:41:39.851471 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bjnr6" Jul 23 22:41:39.880771 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:41:39.880729 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bjnr6" podStartSLOduration=1.880715422 podStartE2EDuration="1.880715422s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 22:41:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 22:41:39.87886089 +0000 UTC m=+1127.598858150" watchObservedRunningTime="2026-07-23 22:41:39.880715422 +0000 UTC m=+1127.600712681" Jul 23 22:41:50.858357 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:41:50.858331 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bjnr6" Jul 23 22:42:22.431002 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:42:22.430908 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:44:27.757482 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:44:27.757445 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:44:43.209037 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:44:43.208998 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:45:13.199174 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:45:13.199137 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:45:14.110968 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:45:14.110939 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:48:24.681163 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:48:24.681089 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:48:38.648834 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:48:38.648799 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:48:45.423516 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:48:45.423474 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:48:48.710174 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:48:48.710133 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:48:48.809430 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:48:48.809396 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:48:49.186219 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:48:49.186180 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:48:55.330016 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:48:55.329980 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:48:55.427879 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:48:55.427853 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:48:55.567854 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:48:55.567823 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:48:55.880943 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:48:55.880912 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:48:56.131788 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:48:56.131709 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:48:58.504615 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:48:58.504581 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:48:58.604082 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:48:58.604051 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:48:58.748844 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:48:58.748812 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:48:58.988088 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:48:58.988057 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:48:59.372745 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:48:59.372671 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:48:59.471385 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:48:59.471356 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:49:34.493785 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:49:34.493745 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:49:35.612741 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:49:35.612708 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:49:39.130873 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:49:39.130828 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:49:39.287174 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:49:39.287141 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:49:39.539375 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:49:39.539347 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:49:39.794238 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:49:39.794162 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:49:39.893180 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:49:39.893153 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:49:40.034388 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:49:40.034359 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:49:40.370357 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:49:40.370328 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:49:40.859861 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:49:40.859829 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:49:42.746987 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:49:42.746958 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:49:42.860746 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:49:42.860719 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:49:43.168331 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:49:43.168252 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:49:43.451437 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:49:43.451401 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:49:43.534717 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:49:43.534693 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:50:17.737013 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:50:17.736981 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:50:18.225766 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:50:18.225737 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:50:18.326091 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:50:18.326055 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:50:18.397353 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:50:18.397322 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:50:22.883680 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:50:22.883644 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:50:23.093427 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:50:23.093393 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:50:23.321947 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:50:23.321921 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:50:23.556566 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:50:23.556534 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:50:23.878791 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:50:23.878763 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:50:24.261517 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:50:24.261479 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:50:25.943484 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:50:25.943437 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:50:26.029593 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:50:26.029564 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:50:26.100690 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:50:26.100661 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:50:26.623010 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:50:26.622977 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:50:26.727000 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:50:26.726970 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:50:26.828860 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:50:26.828832 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:51:02.215484 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:51:02.215447 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:51:02.315709 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:51:02.315676 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:51:05.943851 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:51:05.943791 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:51:06.016794 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:51:06.016765 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:51:06.812838 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:51:06.812803 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:51:08.112234 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:51:08.112208 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:51:08.359100 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:51:08.359069 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:51:08.590743 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:51:08.590705 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:51:08.938212 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:51:08.938179 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:51:09.331293 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:51:09.331198 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:51:11.070723 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:51:11.070689 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:51:11.169271 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:51:11.169240 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:51:11.328615 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:51:11.328554 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:51:11.691359 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:51:11.691324 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:51:11.796773 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:51:11.796745 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:51:11.891087 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:51:11.891061 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:51:46.397788 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:51:46.397711 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:51:46.497206 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:51:46.497173 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:51:51.062521 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:51:51.062488 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:51:51.235347 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:51:51.235315 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:51:51.504464 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:51:51.504436 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:51:52.012783 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:51:52.012752 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:51:52.113040 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:51:52.112986 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:51:52.211791 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:51:52.211768 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:51:53.732284 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:51:53.732227 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:51:55.501307 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:51:55.501278 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:52:00.684771 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:52:00.684738 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:52:00.798222 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:52:00.798188 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:52:00.894692 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:52:00.894659 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:52:00.985760 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:52:00.985686 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:52:01.493346 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:52:01.493306 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:52:27.412573 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:52:27.412542 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:52:34.066837 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:52:34.066781 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:52:34.172693 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:52:34.172666 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:52:34.269433 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:52:34.269407 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:52:50.241424 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:52:50.241356 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:52:56.156696 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:52:56.156662 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:52:56.267901 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:52:56.267856 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:52:56.357874 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:52:56.357841 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:53:06.924850 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:53:06.924816 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:53:07.784699 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:53:07.784663 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:53:13.981287 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:53:13.981252 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:53:14.082845 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:53:14.082809 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:53:14.182825 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:53:14.182797 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:53:14.299773 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:53:14.299669 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:53:15.117382 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:53:15.117345 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:53:15.217358 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:53:15.217324 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:53:15.318591 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:53:15.318553 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:53:17.035574 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:53:17.035547 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:53:23.966638 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:53:23.966604 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:53:24.068122 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:53:24.068089 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:53:24.732006 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:53:24.731972 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:53:30.698104 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:53:30.698070 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:53:30.799089 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:53:30.799057 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:53:30.955848 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:53:30.955750 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:53:31.342090 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:53:31.341910 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:53:31.614895 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:53:31.614821 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:53:34.382874 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:53:34.382826 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:53:34.485761 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:53:34.485722 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:53:34.632838 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:53:34.632801 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:53:34.983951 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:53:34.983916 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:53:35.085979 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:53:35.085932 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:53:35.179367 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:53:35.179325 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:53:38.942959 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:53:38.942901 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:53:39.638715 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:53:39.638665 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:53:39.738868 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:53:39.738833 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:53:40.185335 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:53:40.185301 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:53:46.098500 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:53:46.098462 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:53:46.165875 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:53:46.165834 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:53:56.580073 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:53:56.580036 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:53:56.649346 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:53:56.649309 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:53:56.818632 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:53:56.818589 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:54:01.546913 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:54:01.546876 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:54:01.930802 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:54:01.930773 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:54:08.239776 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:54:08.239740 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:54:08.339637 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:54:08.339603 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:54:08.582626 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:54:08.582549 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:54:08.755330 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:54:08.755302 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:54:08.870468 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:54:08.870391 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:54:08.967805 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:54:08.967779 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:54:09.106724 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:54:09.106700 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:54:15.074525 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:54:15.074450 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:54:15.137359 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:54:15.137332 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:54:15.211660 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:54:15.211633 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:54:15.433246 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:54:15.433220 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:54:21.318269 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:54:21.318235 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:54:21.385129 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:54:21.385108 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:54:28.233720 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:54:28.233685 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:54:28.550852 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:54:28.550769 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:54:28.676168 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:54:28.676135 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:54:31.637421 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:54:31.637388 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:54:31.732795 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:54:31.732757 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:54:31.812233 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:54:31.812196 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:54:32.322689 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:54:32.322659 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:54:32.419555 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:54:32.419525 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:54:32.533845 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:54:32.533812 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:54:36.162398 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:54:36.162370 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:54:47.536127 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:54:47.536097 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:55:31.320358 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:55:31.320322 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:55:31.386315 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:55:31.386279 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:55:31.439600 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:55:31.439568 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:55:35.985097 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:55:35.985057 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:55:39.411923 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:55:39.411893 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:55:44.499212 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:55:44.499180 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:55:49.027599 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:55:49.027563 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:55:56.650504 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:55:56.650471 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:55:56.750769 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:55:56.750731 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:56:21.184052 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:56:21.183990 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:56:21.728114 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:56:21.728086 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:56:27.319909 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:56:27.319844 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:56:33.444745 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:56:33.444712 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:56:33.543541 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:56:33.543513 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:56:33.715898 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:56:33.715832 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:56:33.956936 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:56:33.956904 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:56:35.083064 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:56:35.082971 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:56:35.187564 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:56:35.187533 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:56:35.284182 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:56:35.284158 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:56:36.070107 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:56:36.070079 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:56:36.171989 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:56:36.171956 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:56:36.270720 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:56:36.270696 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:56:37.744478 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:56:37.744447 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:56:43.733981 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:56:43.733952 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:56:43.834731 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:56:43.834705 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:56:44.441079 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:56:44.441046 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:56:50.830674 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:56:50.830635 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:56:50.888227 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:56:50.888197 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:56:50.972380 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:56:50.972350 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:56:51.068723 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:56:51.068697 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:56:52.780560 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:56:52.780529 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:57:01.592115 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:57:01.592085 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:57:01.929516 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:57:01.929486 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:57:22.935249 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:57:22.935164 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:57:29.236230 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:57:29.236196 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:57:29.337808 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:57:29.337767 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:57:29.604576 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:57:29.604500 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:57:29.929827 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:57:29.929800 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:57:30.167663 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:57:30.167623 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:57:32.544948 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:57:32.544913 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:57:32.640126 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:57:32.640092 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:57:32.868783 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:57:32.868713 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:57:33.458116 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:57:33.458085 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:57:33.553316 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:57:33.553285 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:57:33.622950 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:57:33.622919 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:57:37.095272 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:57:37.095236 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:57:37.445403 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:57:37.445368 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:57:37.766766 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:57:37.766683 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:57:37.871085 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:57:37.871055 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:57:40.560369 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:57:40.560334 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:57:40.659715 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:57:40.659686 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:57:40.717889 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:57:40.717850 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:57:40.795814 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:57:40.795787 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:57:41.225197 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:57:41.225139 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:57:41.324119 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:57:41.324092 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:57:45.079102 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:57:45.079068 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:57:50.817579 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:57:50.817548 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:58:37.013248 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:58:37.013203 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:58:55.232281 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:58:55.232179 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:58:55.330861 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:58:55.330832 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:59:30.537815 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:59:30.537768 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:59:31.456075 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:59:31.456046 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:59:41.975563 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:59:41.975534 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:59:43.063679 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:59:43.063644 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:59:46.662121 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:59:46.662090 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:59:47.069618 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:59:47.069579 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:59:52.924220 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:59:52.924186 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:59:53.024613 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:59:53.024567 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:59:53.080865 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:59:53.080835 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:59:53.283932 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:59:53.283836 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 22:59:53.499235 ip-10-0-134-206 kubenswrapper[2575]: I0723 22:59:53.499204 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:00:04.062708 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:00:04.062667 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:00:04.161887 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:00:04.161853 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:00:08.688242 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:00:08.688210 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:00:09.087665 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:00:09.087586 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:00:15.202431 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:00:15.202355 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:00:15.301194 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:00:15.301169 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:00:15.391841 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:00:15.391810 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:00:15.630344 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:00:15.630269 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:00:16.004191 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:00:16.004160 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:00:16.285559 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:00:16.285489 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:00:16.392259 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:00:16.392229 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:00:19.344923 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:00:19.344892 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:00:19.439460 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:00:19.439428 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:00:19.584671 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:00:19.584640 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:00:19.702127 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:00:19.702090 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:00:20.017289 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:00:20.017203 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:00:20.110003 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:00:20.109964 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:00:23.875148 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:00:23.875106 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:00:24.357689 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:00:24.357662 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:00:24.667140 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:00:24.667050 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:00:24.947748 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:00:24.947721 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:00:27.399176 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:00:27.399136 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:00:27.475443 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:00:27.475413 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:00:27.538726 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:00:27.538700 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:00:28.044884 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:00:28.044848 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:00:28.156952 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:00:28.156919 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:00:31.946128 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:00:31.946098 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:00:55.918180 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:00:55.918148 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:00:56.018273 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:00:56.018237 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:00:56.119795 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:00:56.119768 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:01:00.194773 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:01:00.194735 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:01:00.574871 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:01:00.574797 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:01:06.858709 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:01:06.858678 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:01:06.924536 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:01:06.924509 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:01:07.102558 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:01:07.102534 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:01:22.792670 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:01:22.792635 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:01:22.865427 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:01:22.865391 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:01:23.234035 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:01:23.233993 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:01:27.295193 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:01:27.295155 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:01:27.704766 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:01:27.704734 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:01:33.755697 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:01:33.755651 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:01:33.811807 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:01:33.811778 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:01:34.050842 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:01:34.050750 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:01:34.302959 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:01:34.302869 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:01:34.679824 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:01:34.679786 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:01:35.006743 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:01:35.006663 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:01:35.107593 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:01:35.107550 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:01:37.806467 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:01:37.806412 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:01:37.891260 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:01:37.891224 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:01:37.945945 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:01:37.945918 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:01:38.230319 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:01:38.230289 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:01:38.484290 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:01:38.484189 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:01:38.587437 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:01:38.587403 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:01:42.371724 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:01:42.371694 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:01:42.714295 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:01:42.714262 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:01:43.103225 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:01:43.103110 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:01:43.246122 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:01:43.246094 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:01:45.815214 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:01:45.815116 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:01:45.890048 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:01:45.890007 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:01:45.950408 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:01:45.950382 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:01:46.421755 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:01:46.421724 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:01:46.520448 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:01:46.520412 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:01:46.588910 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:01:46.588879 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:01:50.342163 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:01:50.342132 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:02:07.624355 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:02:07.624317 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:02:26.748575 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:02:26.748539 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:02:27.099354 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:02:27.099252 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:02:47.537947 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:02:47.537913 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:04:26.902880 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:04:26.902845 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:04:27.818816 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:04:27.818787 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:04:51.948215 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:04:51.948136 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:04:54.400662 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:04:54.400612 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:05:15.107721 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:05:15.107686 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:05:47.182994 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:05:47.182956 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:05:58.917213 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:05:58.917177 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:06:02.798798 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:06:02.798769 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:06:03.691043 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:06:03.690999 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:06:07.119876 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:06:07.119844 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:06:33.935240 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:06:33.935164 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:06:43.147750 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:06:43.147710 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:07:17.657757 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:17.657725 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:07:18.494860 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:18.494824 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:07:19.490584 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:19.490550 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7662-139691542645296"] Jul 23 23:07:19.494186 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:19.494170 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7662-139691542645296" Jul 23 23:07:19.496502 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:19.496450 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-lwjxb\"" Jul 23 23:07:19.498945 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:19.498825 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7662-139691542645296"] Jul 23 23:07:19.585585 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:19.585560 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nx88l\" (UniqueName: \"kubernetes.io/projected/cde63799-f809-4461-9077-211962389a4d-kube-api-access-nx88l\") pod \"test-curl-7662-139691542645296\" (UID: \"cde63799-f809-4461-9077-211962389a4d\") " pod="opendatahub/test-curl-7662-139691542645296" Jul 23 23:07:19.686426 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:19.686398 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nx88l\" (UniqueName: \"kubernetes.io/projected/cde63799-f809-4461-9077-211962389a4d-kube-api-access-nx88l\") pod \"test-curl-7662-139691542645296\" (UID: \"cde63799-f809-4461-9077-211962389a4d\") " pod="opendatahub/test-curl-7662-139691542645296" Jul 23 23:07:19.694046 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:19.693997 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nx88l\" (UniqueName: \"kubernetes.io/projected/cde63799-f809-4461-9077-211962389a4d-kube-api-access-nx88l\") pod \"test-curl-7662-139691542645296\" (UID: \"cde63799-f809-4461-9077-211962389a4d\") " pod="opendatahub/test-curl-7662-139691542645296" Jul 23 23:07:19.804823 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:19.804768 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7662-139691542645296" Jul 23 23:07:19.931960 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:19.931934 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7662-139691542645296"] Jul 23 23:07:19.933810 ip-10-0-134-206 kubenswrapper[2575]: W0723 23:07:19.933785 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcde63799_f809_4461_9077_211962389a4d.slice/crio-97a48f6c2be47a3e3fe1de1c28bd229daea1e4fd3d08515bb2b1a91ad455deef WatchSource:0}: Error finding container 97a48f6c2be47a3e3fe1de1c28bd229daea1e4fd3d08515bb2b1a91ad455deef: Status 404 returned error can't find the container with id 97a48f6c2be47a3e3fe1de1c28bd229daea1e4fd3d08515bb2b1a91ad455deef Jul 23 23:07:19.935617 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:19.935594 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 23 23:07:20.350646 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:20.350612 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7662-139691542645296" event={"ID":"cde63799-f809-4461-9077-211962389a4d","Type":"ContainerStarted","Data":"97a48f6c2be47a3e3fe1de1c28bd229daea1e4fd3d08515bb2b1a91ad455deef"} Jul 23 23:07:21.357517 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:21.357480 2575 generic.go:356] "Generic (PLEG): container finished" podID="cde63799-f809-4461-9077-211962389a4d" containerID="b08056faa17097be3a12b73c133bc5451714258c01ec0adb24de5b4e49d5fea0" exitCode=0 Jul 23 23:07:21.357885 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:21.357573 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7662-139691542645296" event={"ID":"cde63799-f809-4461-9077-211962389a4d","Type":"ContainerDied","Data":"b08056faa17097be3a12b73c133bc5451714258c01ec0adb24de5b4e49d5fea0"} Jul 23 23:07:22.498539 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:22.498514 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7662-139691542645296" Jul 23 23:07:22.510325 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:22.510296 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nx88l\" (UniqueName: \"kubernetes.io/projected/cde63799-f809-4461-9077-211962389a4d-kube-api-access-nx88l\") pod \"cde63799-f809-4461-9077-211962389a4d\" (UID: \"cde63799-f809-4461-9077-211962389a4d\") " Jul 23 23:07:22.512137 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:22.512112 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cde63799-f809-4461-9077-211962389a4d-kube-api-access-nx88l" (OuterVolumeSpecName: "kube-api-access-nx88l") pod "cde63799-f809-4461-9077-211962389a4d" (UID: "cde63799-f809-4461-9077-211962389a4d"). InnerVolumeSpecName "kube-api-access-nx88l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 23:07:22.518061 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:22.518017 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7662-139691542645296_cde63799-f809-4461-9077-211962389a4d/test-curl-7662-139691542645296/0.log" Jul 23 23:07:22.540825 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:22.540802 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7662-139691542645296"] Jul 23 23:07:22.544444 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:22.544425 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7662-139691542645296"] Jul 23 23:07:22.611473 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:22.611446 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nx88l\" (UniqueName: \"kubernetes.io/projected/cde63799-f809-4461-9077-211962389a4d-kube-api-access-nx88l\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 23:07:22.667749 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:22.667697 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7662-139691542645424"] Jul 23 23:07:22.668153 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:22.668139 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cde63799-f809-4461-9077-211962389a4d" containerName="test-curl-7662-139691542645296" Jul 23 23:07:22.668198 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:22.668156 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="cde63799-f809-4461-9077-211962389a4d" containerName="test-curl-7662-139691542645296" Jul 23 23:07:22.668233 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:22.668221 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="cde63799-f809-4461-9077-211962389a4d" containerName="test-curl-7662-139691542645296" Jul 23 23:07:22.671487 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:22.671472 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7662-139691542645424" Jul 23 23:07:22.677785 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:22.677552 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7662-139691542645424"] Jul 23 23:07:22.712507 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:22.712481 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28s4b\" (UniqueName: \"kubernetes.io/projected/f63538b9-70c0-45bf-a7cf-3df11eca0b22-kube-api-access-28s4b\") pod \"test-curl-7662-139691542645424\" (UID: \"f63538b9-70c0-45bf-a7cf-3df11eca0b22\") " pod="opendatahub/test-curl-7662-139691542645424" Jul 23 23:07:22.809287 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:22.809262 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cde63799-f809-4461-9077-211962389a4d" path="/var/lib/kubelet/pods/cde63799-f809-4461-9077-211962389a4d/volumes" Jul 23 23:07:22.813610 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:22.813589 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28s4b\" (UniqueName: \"kubernetes.io/projected/f63538b9-70c0-45bf-a7cf-3df11eca0b22-kube-api-access-28s4b\") pod \"test-curl-7662-139691542645424\" (UID: \"f63538b9-70c0-45bf-a7cf-3df11eca0b22\") " pod="opendatahub/test-curl-7662-139691542645424" Jul 23 23:07:22.821009 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:22.820986 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-28s4b\" (UniqueName: \"kubernetes.io/projected/f63538b9-70c0-45bf-a7cf-3df11eca0b22-kube-api-access-28s4b\") pod \"test-curl-7662-139691542645424\" (UID: \"f63538b9-70c0-45bf-a7cf-3df11eca0b22\") " pod="opendatahub/test-curl-7662-139691542645424" Jul 23 23:07:22.982382 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:22.982362 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7662-139691542645424" Jul 23 23:07:23.115499 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:23.115471 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7662-139691542645424"] Jul 23 23:07:23.116947 ip-10-0-134-206 kubenswrapper[2575]: W0723 23:07:23.116924 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf63538b9_70c0_45bf_a7cf_3df11eca0b22.slice/crio-5c1d033da5a09e515158257da009d1587cdde0df78daa96422061f71c16ec0c5 WatchSource:0}: Error finding container 5c1d033da5a09e515158257da009d1587cdde0df78daa96422061f71c16ec0c5: Status 404 returned error can't find the container with id 5c1d033da5a09e515158257da009d1587cdde0df78daa96422061f71c16ec0c5 Jul 23 23:07:23.369643 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:23.369583 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7662-139691542645296" Jul 23 23:07:23.369643 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:23.369618 2575 scope.go:117] "RemoveContainer" containerID="b08056faa17097be3a12b73c133bc5451714258c01ec0adb24de5b4e49d5fea0" Jul 23 23:07:23.371033 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:23.370990 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7662-139691542645424" event={"ID":"f63538b9-70c0-45bf-a7cf-3df11eca0b22","Type":"ContainerStarted","Data":"5c1d033da5a09e515158257da009d1587cdde0df78daa96422061f71c16ec0c5"} Jul 23 23:07:24.378977 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:24.378944 2575 generic.go:356] "Generic (PLEG): container finished" podID="f63538b9-70c0-45bf-a7cf-3df11eca0b22" containerID="b3f1530b0e87b8b4b376c35981ece4b61581f78b0e3fb6ccb72ea08e0c494744" exitCode=0 Jul 23 23:07:24.379369 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:24.379053 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7662-139691542645424" event={"ID":"f63538b9-70c0-45bf-a7cf-3df11eca0b22","Type":"ContainerDied","Data":"b3f1530b0e87b8b4b376c35981ece4b61581f78b0e3fb6ccb72ea08e0c494744"} Jul 23 23:07:25.521457 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:25.521429 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7662-139691542645424" Jul 23 23:07:25.532090 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:25.532066 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-28s4b\" (UniqueName: \"kubernetes.io/projected/f63538b9-70c0-45bf-a7cf-3df11eca0b22-kube-api-access-28s4b\") pod \"f63538b9-70c0-45bf-a7cf-3df11eca0b22\" (UID: \"f63538b9-70c0-45bf-a7cf-3df11eca0b22\") " Jul 23 23:07:25.534004 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:25.533979 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f63538b9-70c0-45bf-a7cf-3df11eca0b22-kube-api-access-28s4b" (OuterVolumeSpecName: "kube-api-access-28s4b") pod "f63538b9-70c0-45bf-a7cf-3df11eca0b22" (UID: "f63538b9-70c0-45bf-a7cf-3df11eca0b22"). InnerVolumeSpecName "kube-api-access-28s4b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 23:07:25.541312 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:25.541277 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7662-139691542645424_f63538b9-70c0-45bf-a7cf-3df11eca0b22/test-curl-7662-139691542645424/0.log" Jul 23 23:07:25.568165 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:25.568125 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7662-139691542645424"] Jul 23 23:07:25.570446 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:25.570422 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7662-139691542645424"] Jul 23 23:07:25.632879 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:25.632849 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-28s4b\" (UniqueName: \"kubernetes.io/projected/f63538b9-70c0-45bf-a7cf-3df11eca0b22-kube-api-access-28s4b\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 23:07:25.754342 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:25.754312 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7662-139691538091728"] Jul 23 23:07:25.754761 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:25.754747 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f63538b9-70c0-45bf-a7cf-3df11eca0b22" containerName="test-curl-7662-139691542645424" Jul 23 23:07:25.754804 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:25.754763 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f63538b9-70c0-45bf-a7cf-3df11eca0b22" containerName="test-curl-7662-139691542645424" Jul 23 23:07:25.754867 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:25.754856 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="f63538b9-70c0-45bf-a7cf-3df11eca0b22" containerName="test-curl-7662-139691542645424" Jul 23 23:07:25.757976 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:25.757947 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7662-139691538091728" Jul 23 23:07:25.764041 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:25.763990 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7662-139691538091728"] Jul 23 23:07:25.834741 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:25.834702 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stqs5\" (UniqueName: \"kubernetes.io/projected/1854a1c4-e96b-449c-aebb-02529a0e82b7-kube-api-access-stqs5\") pod \"test-curl-7662-139691538091728\" (UID: \"1854a1c4-e96b-449c-aebb-02529a0e82b7\") " pod="opendatahub/test-curl-7662-139691538091728" Jul 23 23:07:25.936192 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:25.936159 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stqs5\" (UniqueName: \"kubernetes.io/projected/1854a1c4-e96b-449c-aebb-02529a0e82b7-kube-api-access-stqs5\") pod \"test-curl-7662-139691538091728\" (UID: \"1854a1c4-e96b-449c-aebb-02529a0e82b7\") " pod="opendatahub/test-curl-7662-139691538091728" Jul 23 23:07:25.943816 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:25.943788 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-stqs5\" (UniqueName: \"kubernetes.io/projected/1854a1c4-e96b-449c-aebb-02529a0e82b7-kube-api-access-stqs5\") pod \"test-curl-7662-139691538091728\" (UID: \"1854a1c4-e96b-449c-aebb-02529a0e82b7\") " pod="opendatahub/test-curl-7662-139691538091728" Jul 23 23:07:26.070297 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:26.070211 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7662-139691538091728" Jul 23 23:07:26.203560 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:26.203531 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7662-139691538091728"] Jul 23 23:07:26.205138 ip-10-0-134-206 kubenswrapper[2575]: W0723 23:07:26.205109 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1854a1c4_e96b_449c_aebb_02529a0e82b7.slice/crio-1b88c1784ab37daaf38f03eed9d00025439e546ded585812598b2d798f34b9dd WatchSource:0}: Error finding container 1b88c1784ab37daaf38f03eed9d00025439e546ded585812598b2d798f34b9dd: Status 404 returned error can't find the container with id 1b88c1784ab37daaf38f03eed9d00025439e546ded585812598b2d798f34b9dd Jul 23 23:07:26.391425 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:26.391340 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7662-139691542645424" Jul 23 23:07:26.391425 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:26.391346 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5c1d033da5a09e515158257da009d1587cdde0df78daa96422061f71c16ec0c5" Jul 23 23:07:26.392632 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:26.392598 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7662-139691538091728" event={"ID":"1854a1c4-e96b-449c-aebb-02529a0e82b7","Type":"ContainerStarted","Data":"1b88c1784ab37daaf38f03eed9d00025439e546ded585812598b2d798f34b9dd"} Jul 23 23:07:26.401871 ip-10-0-134-206 kubenswrapper[2575]: E0723 23:07:26.401846 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7662-139691542645424\" is forbidden: User \"system:node:ip-10-0-134-206.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-206.ec2.internal' and this object" podUID="f63538b9-70c0-45bf-a7cf-3df11eca0b22" pod="opendatahub/test-curl-7662-139691542645424" Jul 23 23:07:26.808430 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:26.808397 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f63538b9-70c0-45bf-a7cf-3df11eca0b22" path="/var/lib/kubelet/pods/f63538b9-70c0-45bf-a7cf-3df11eca0b22/volumes" Jul 23 23:07:27.399579 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:27.399537 2575 generic.go:356] "Generic (PLEG): container finished" podID="1854a1c4-e96b-449c-aebb-02529a0e82b7" containerID="440d8bbac3de0c5819777b69ddb5fe04541e9c940c333ca62226db428a6b4b46" exitCode=0 Jul 23 23:07:27.399783 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:27.399625 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7662-139691538091728" event={"ID":"1854a1c4-e96b-449c-aebb-02529a0e82b7","Type":"ContainerDied","Data":"440d8bbac3de0c5819777b69ddb5fe04541e9c940c333ca62226db428a6b4b46"} Jul 23 23:07:28.542622 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:28.542594 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7662-139691538091728" Jul 23 23:07:28.558155 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:28.558126 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-stqs5\" (UniqueName: \"kubernetes.io/projected/1854a1c4-e96b-449c-aebb-02529a0e82b7-kube-api-access-stqs5\") pod \"1854a1c4-e96b-449c-aebb-02529a0e82b7\" (UID: \"1854a1c4-e96b-449c-aebb-02529a0e82b7\") " Jul 23 23:07:28.560730 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:28.560698 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1854a1c4-e96b-449c-aebb-02529a0e82b7-kube-api-access-stqs5" (OuterVolumeSpecName: "kube-api-access-stqs5") pod "1854a1c4-e96b-449c-aebb-02529a0e82b7" (UID: "1854a1c4-e96b-449c-aebb-02529a0e82b7"). InnerVolumeSpecName "kube-api-access-stqs5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 23:07:28.563128 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:28.563108 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7662-139691538091728_1854a1c4-e96b-449c-aebb-02529a0e82b7/test-curl-7662-139691538091728/0.log" Jul 23 23:07:28.588309 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:28.588279 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7662-139691538091728"] Jul 23 23:07:28.591957 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:28.591936 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7662-139691538091728"] Jul 23 23:07:28.659526 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:28.659450 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-stqs5\" (UniqueName: \"kubernetes.io/projected/1854a1c4-e96b-449c-aebb-02529a0e82b7-kube-api-access-stqs5\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 23:07:28.719293 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:28.719259 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7662-139691538091728"] Jul 23 23:07:28.719736 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:28.719723 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1854a1c4-e96b-449c-aebb-02529a0e82b7" containerName="test-curl-7662-139691538091728" Jul 23 23:07:28.719778 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:28.719737 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="1854a1c4-e96b-449c-aebb-02529a0e82b7" containerName="test-curl-7662-139691538091728" Jul 23 23:07:28.719816 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:28.719810 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="1854a1c4-e96b-449c-aebb-02529a0e82b7" containerName="test-curl-7662-139691538091728" Jul 23 23:07:28.722792 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:28.722775 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7662-139691538091728" Jul 23 23:07:28.727454 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:28.727424 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7662-139691538091728"] Jul 23 23:07:28.760890 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:28.760857 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zx6v\" (UniqueName: \"kubernetes.io/projected/2dadccfd-c9f3-4e1b-bde3-90a79292838a-kube-api-access-2zx6v\") pod \"test-curl-7662-139691538091728\" (UID: \"2dadccfd-c9f3-4e1b-bde3-90a79292838a\") " pod="opendatahub/test-curl-7662-139691538091728" Jul 23 23:07:28.808096 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:28.808058 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1854a1c4-e96b-449c-aebb-02529a0e82b7" path="/var/lib/kubelet/pods/1854a1c4-e96b-449c-aebb-02529a0e82b7/volumes" Jul 23 23:07:28.861741 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:28.861707 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zx6v\" (UniqueName: \"kubernetes.io/projected/2dadccfd-c9f3-4e1b-bde3-90a79292838a-kube-api-access-2zx6v\") pod \"test-curl-7662-139691538091728\" (UID: \"2dadccfd-c9f3-4e1b-bde3-90a79292838a\") " pod="opendatahub/test-curl-7662-139691538091728" Jul 23 23:07:28.870545 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:28.870517 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zx6v\" (UniqueName: \"kubernetes.io/projected/2dadccfd-c9f3-4e1b-bde3-90a79292838a-kube-api-access-2zx6v\") pod \"test-curl-7662-139691538091728\" (UID: \"2dadccfd-c9f3-4e1b-bde3-90a79292838a\") " pod="opendatahub/test-curl-7662-139691538091728" Jul 23 23:07:29.033371 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:29.033328 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7662-139691538091728" Jul 23 23:07:29.170280 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:29.170256 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7662-139691538091728"] Jul 23 23:07:29.171968 ip-10-0-134-206 kubenswrapper[2575]: W0723 23:07:29.171937 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2dadccfd_c9f3_4e1b_bde3_90a79292838a.slice/crio-a6f215d9f69b8f3fb600d91663310644d8997fd5314cddb3017e776229768d48 WatchSource:0}: Error finding container a6f215d9f69b8f3fb600d91663310644d8997fd5314cddb3017e776229768d48: Status 404 returned error can't find the container with id a6f215d9f69b8f3fb600d91663310644d8997fd5314cddb3017e776229768d48 Jul 23 23:07:29.413243 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:29.413148 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7662-139691538091728" event={"ID":"2dadccfd-c9f3-4e1b-bde3-90a79292838a","Type":"ContainerStarted","Data":"a6f215d9f69b8f3fb600d91663310644d8997fd5314cddb3017e776229768d48"} Jul 23 23:07:29.414368 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:29.414339 2575 scope.go:117] "RemoveContainer" containerID="440d8bbac3de0c5819777b69ddb5fe04541e9c940c333ca62226db428a6b4b46" Jul 23 23:07:29.414368 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:29.414365 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7662-139691538091728" Jul 23 23:07:30.422105 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:30.422067 2575 generic.go:356] "Generic (PLEG): container finished" podID="2dadccfd-c9f3-4e1b-bde3-90a79292838a" containerID="a77544b81d32ad8b644b17f5585247d9ef69ac9d98a9909cffffae12005e7c54" exitCode=0 Jul 23 23:07:30.422436 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:30.422118 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7662-139691538091728" event={"ID":"2dadccfd-c9f3-4e1b-bde3-90a79292838a","Type":"ContainerDied","Data":"a77544b81d32ad8b644b17f5585247d9ef69ac9d98a9909cffffae12005e7c54"} Jul 23 23:07:31.565348 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:31.565325 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7662-139691538091728" Jul 23 23:07:31.584419 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:31.584398 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7662-139691538091728_2dadccfd-c9f3-4e1b-bde3-90a79292838a/test-curl-7662-139691538091728/0.log" Jul 23 23:07:31.608403 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:31.608375 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7662-139691538091728"] Jul 23 23:07:31.611532 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:31.611509 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7662-139691538091728"] Jul 23 23:07:31.685577 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:31.685524 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2zx6v\" (UniqueName: \"kubernetes.io/projected/2dadccfd-c9f3-4e1b-bde3-90a79292838a-kube-api-access-2zx6v\") pod \"2dadccfd-c9f3-4e1b-bde3-90a79292838a\" (UID: \"2dadccfd-c9f3-4e1b-bde3-90a79292838a\") " Jul 23 23:07:31.687355 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:31.687333 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2dadccfd-c9f3-4e1b-bde3-90a79292838a-kube-api-access-2zx6v" (OuterVolumeSpecName: "kube-api-access-2zx6v") pod "2dadccfd-c9f3-4e1b-bde3-90a79292838a" (UID: "2dadccfd-c9f3-4e1b-bde3-90a79292838a"). InnerVolumeSpecName "kube-api-access-2zx6v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 23:07:31.736577 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:31.736553 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7662-139691542462800"] Jul 23 23:07:31.736945 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:31.736933 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2dadccfd-c9f3-4e1b-bde3-90a79292838a" containerName="test-curl-7662-139691538091728" Jul 23 23:07:31.736987 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:31.736946 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="2dadccfd-c9f3-4e1b-bde3-90a79292838a" containerName="test-curl-7662-139691538091728" Jul 23 23:07:31.737071 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:31.737014 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="2dadccfd-c9f3-4e1b-bde3-90a79292838a" containerName="test-curl-7662-139691538091728" Jul 23 23:07:31.740119 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:31.740104 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7662-139691542462800" Jul 23 23:07:31.747761 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:31.747720 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7662-139691542462800"] Jul 23 23:07:31.786113 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:31.786086 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gp7bj\" (UniqueName: \"kubernetes.io/projected/96c29eb5-66b8-4f7a-b96f-41b939b3714a-kube-api-access-gp7bj\") pod \"test-curl-7662-139691542462800\" (UID: \"96c29eb5-66b8-4f7a-b96f-41b939b3714a\") " pod="opendatahub/test-curl-7662-139691542462800" Jul 23 23:07:31.786214 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:31.786146 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2zx6v\" (UniqueName: \"kubernetes.io/projected/2dadccfd-c9f3-4e1b-bde3-90a79292838a-kube-api-access-2zx6v\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 23:07:31.886910 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:31.886880 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gp7bj\" (UniqueName: \"kubernetes.io/projected/96c29eb5-66b8-4f7a-b96f-41b939b3714a-kube-api-access-gp7bj\") pod \"test-curl-7662-139691542462800\" (UID: \"96c29eb5-66b8-4f7a-b96f-41b939b3714a\") " pod="opendatahub/test-curl-7662-139691542462800" Jul 23 23:07:31.895908 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:31.895884 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gp7bj\" (UniqueName: \"kubernetes.io/projected/96c29eb5-66b8-4f7a-b96f-41b939b3714a-kube-api-access-gp7bj\") pod \"test-curl-7662-139691542462800\" (UID: \"96c29eb5-66b8-4f7a-b96f-41b939b3714a\") " pod="opendatahub/test-curl-7662-139691542462800" Jul 23 23:07:32.051698 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:32.051642 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7662-139691542462800" Jul 23 23:07:32.180665 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:32.180643 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7662-139691542462800"] Jul 23 23:07:32.182041 ip-10-0-134-206 kubenswrapper[2575]: W0723 23:07:32.182001 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod96c29eb5_66b8_4f7a_b96f_41b939b3714a.slice/crio-9ed4ad66b38ee97ecab8be2d4bf85e9d860e48d3bfc7faec84018e50f199e25f WatchSource:0}: Error finding container 9ed4ad66b38ee97ecab8be2d4bf85e9d860e48d3bfc7faec84018e50f199e25f: Status 404 returned error can't find the container with id 9ed4ad66b38ee97ecab8be2d4bf85e9d860e48d3bfc7faec84018e50f199e25f Jul 23 23:07:32.434590 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:32.434569 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7662-139691538091728" Jul 23 23:07:32.434713 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:32.434574 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a6f215d9f69b8f3fb600d91663310644d8997fd5314cddb3017e776229768d48" Jul 23 23:07:32.435729 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:32.435704 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7662-139691542462800" event={"ID":"96c29eb5-66b8-4f7a-b96f-41b939b3714a","Type":"ContainerStarted","Data":"9ed4ad66b38ee97ecab8be2d4bf85e9d860e48d3bfc7faec84018e50f199e25f"} Jul 23 23:07:32.444716 ip-10-0-134-206 kubenswrapper[2575]: E0723 23:07:32.444689 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7662-139691538091728\" is forbidden: User \"system:node:ip-10-0-134-206.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-206.ec2.internal' and this object" podUID="2dadccfd-c9f3-4e1b-bde3-90a79292838a" pod="opendatahub/test-curl-7662-139691538091728" Jul 23 23:07:32.806221 ip-10-0-134-206 kubenswrapper[2575]: E0723 23:07:32.806127 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7662-139691538091728\" is forbidden: User \"system:node:ip-10-0-134-206.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-206.ec2.internal' and this object" podUID="2dadccfd-c9f3-4e1b-bde3-90a79292838a" pod="opendatahub/test-curl-7662-139691538091728" Jul 23 23:07:32.807738 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:32.807710 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2dadccfd-c9f3-4e1b-bde3-90a79292838a" path="/var/lib/kubelet/pods/2dadccfd-c9f3-4e1b-bde3-90a79292838a/volumes" Jul 23 23:07:33.443059 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:33.443004 2575 generic.go:356] "Generic (PLEG): container finished" podID="96c29eb5-66b8-4f7a-b96f-41b939b3714a" containerID="66e2ae9c8432d4542cd1079bb70ea1c7c0faff847df3266e82754b4bd907862b" exitCode=0 Jul 23 23:07:33.443227 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:33.443085 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7662-139691542462800" event={"ID":"96c29eb5-66b8-4f7a-b96f-41b939b3714a","Type":"ContainerDied","Data":"66e2ae9c8432d4542cd1079bb70ea1c7c0faff847df3266e82754b4bd907862b"} Jul 23 23:07:34.579905 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:34.579883 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7662-139691542462800" Jul 23 23:07:34.598745 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:34.598718 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7662-139691542462800_96c29eb5-66b8-4f7a-b96f-41b939b3714a/test-curl-7662-139691542462800/0.log" Jul 23 23:07:34.611269 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:34.611236 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gp7bj\" (UniqueName: \"kubernetes.io/projected/96c29eb5-66b8-4f7a-b96f-41b939b3714a-kube-api-access-gp7bj\") pod \"96c29eb5-66b8-4f7a-b96f-41b939b3714a\" (UID: \"96c29eb5-66b8-4f7a-b96f-41b939b3714a\") " Jul 23 23:07:34.613300 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:34.613273 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96c29eb5-66b8-4f7a-b96f-41b939b3714a-kube-api-access-gp7bj" (OuterVolumeSpecName: "kube-api-access-gp7bj") pod "96c29eb5-66b8-4f7a-b96f-41b939b3714a" (UID: "96c29eb5-66b8-4f7a-b96f-41b939b3714a"). InnerVolumeSpecName "kube-api-access-gp7bj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 23:07:34.626788 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:34.626764 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7662-139691542462800"] Jul 23 23:07:34.629078 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:34.629056 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7662-139691542462800"] Jul 23 23:07:34.712641 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:34.712554 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gp7bj\" (UniqueName: \"kubernetes.io/projected/96c29eb5-66b8-4f7a-b96f-41b939b3714a-kube-api-access-gp7bj\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 23:07:34.764036 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:34.763994 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7662-139691542462800"] Jul 23 23:07:34.764494 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:34.764475 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96c29eb5-66b8-4f7a-b96f-41b939b3714a" containerName="test-curl-7662-139691542462800" Jul 23 23:07:34.764581 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:34.764496 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="96c29eb5-66b8-4f7a-b96f-41b939b3714a" containerName="test-curl-7662-139691542462800" Jul 23 23:07:34.764648 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:34.764635 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="96c29eb5-66b8-4f7a-b96f-41b939b3714a" containerName="test-curl-7662-139691542462800" Jul 23 23:07:34.767807 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:34.767787 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7662-139691542462800" Jul 23 23:07:34.774055 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:34.774010 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7662-139691542462800"] Jul 23 23:07:34.808278 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:34.808249 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96c29eb5-66b8-4f7a-b96f-41b939b3714a" path="/var/lib/kubelet/pods/96c29eb5-66b8-4f7a-b96f-41b939b3714a/volumes" Jul 23 23:07:34.813325 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:34.813305 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85rz5\" (UniqueName: \"kubernetes.io/projected/4bf62d38-245c-432f-a92a-ac26fceb729e-kube-api-access-85rz5\") pod \"test-curl-7662-139691542462800\" (UID: \"4bf62d38-245c-432f-a92a-ac26fceb729e\") " pod="opendatahub/test-curl-7662-139691542462800" Jul 23 23:07:34.914383 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:34.914334 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85rz5\" (UniqueName: \"kubernetes.io/projected/4bf62d38-245c-432f-a92a-ac26fceb729e-kube-api-access-85rz5\") pod \"test-curl-7662-139691542462800\" (UID: \"4bf62d38-245c-432f-a92a-ac26fceb729e\") " pod="opendatahub/test-curl-7662-139691542462800" Jul 23 23:07:34.921993 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:34.921957 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85rz5\" (UniqueName: \"kubernetes.io/projected/4bf62d38-245c-432f-a92a-ac26fceb729e-kube-api-access-85rz5\") pod \"test-curl-7662-139691542462800\" (UID: \"4bf62d38-245c-432f-a92a-ac26fceb729e\") " pod="opendatahub/test-curl-7662-139691542462800" Jul 23 23:07:35.078586 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:35.078494 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7662-139691542462800" Jul 23 23:07:35.210257 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:35.210232 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7662-139691542462800"] Jul 23 23:07:35.212319 ip-10-0-134-206 kubenswrapper[2575]: W0723 23:07:35.212291 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4bf62d38_245c_432f_a92a_ac26fceb729e.slice/crio-1e3f73aebd95d696d452d2ddb64801c0998205f1814ee664c2b19fa30edac063 WatchSource:0}: Error finding container 1e3f73aebd95d696d452d2ddb64801c0998205f1814ee664c2b19fa30edac063: Status 404 returned error can't find the container with id 1e3f73aebd95d696d452d2ddb64801c0998205f1814ee664c2b19fa30edac063 Jul 23 23:07:35.461894 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:35.461857 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7662-139691542462800" event={"ID":"4bf62d38-245c-432f-a92a-ac26fceb729e","Type":"ContainerStarted","Data":"1e3f73aebd95d696d452d2ddb64801c0998205f1814ee664c2b19fa30edac063"} Jul 23 23:07:35.463099 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:35.463077 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7662-139691542462800" Jul 23 23:07:35.463221 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:35.463088 2575 scope.go:117] "RemoveContainer" containerID="66e2ae9c8432d4542cd1079bb70ea1c7c0faff847df3266e82754b4bd907862b" Jul 23 23:07:36.470636 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:36.470601 2575 generic.go:356] "Generic (PLEG): container finished" podID="4bf62d38-245c-432f-a92a-ac26fceb729e" containerID="a9c7e914912e212ed25a838453104721ec09f2758e13a0b30e28c44819ed4d66" exitCode=0 Jul 23 23:07:36.471056 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:36.470679 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7662-139691542462800" event={"ID":"4bf62d38-245c-432f-a92a-ac26fceb729e","Type":"ContainerDied","Data":"a9c7e914912e212ed25a838453104721ec09f2758e13a0b30e28c44819ed4d66"} Jul 23 23:07:37.633480 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:37.633451 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7662-139691542462800" Jul 23 23:07:37.653135 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:37.653113 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7662-139691542462800_4bf62d38-245c-432f-a92a-ac26fceb729e/test-curl-7662-139691542462800/0.log" Jul 23 23:07:37.676686 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:37.676655 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7662-139691542462800"] Jul 23 23:07:37.678790 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:37.678770 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7662-139691542462800"] Jul 23 23:07:37.742086 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:37.742015 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-85rz5\" (UniqueName: \"kubernetes.io/projected/4bf62d38-245c-432f-a92a-ac26fceb729e-kube-api-access-85rz5\") pod \"4bf62d38-245c-432f-a92a-ac26fceb729e\" (UID: \"4bf62d38-245c-432f-a92a-ac26fceb729e\") " Jul 23 23:07:37.743842 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:37.743814 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4bf62d38-245c-432f-a92a-ac26fceb729e-kube-api-access-85rz5" (OuterVolumeSpecName: "kube-api-access-85rz5") pod "4bf62d38-245c-432f-a92a-ac26fceb729e" (UID: "4bf62d38-245c-432f-a92a-ac26fceb729e"). InnerVolumeSpecName "kube-api-access-85rz5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 23:07:37.843546 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:37.843508 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-85rz5\" (UniqueName: \"kubernetes.io/projected/4bf62d38-245c-432f-a92a-ac26fceb729e-kube-api-access-85rz5\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 23:07:38.189377 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:38.189354 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:07:38.484849 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:38.484773 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7662-139691542462800" Jul 23 23:07:38.484849 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:38.484806 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1e3f73aebd95d696d452d2ddb64801c0998205f1814ee664c2b19fa30edac063" Jul 23 23:07:38.494983 ip-10-0-134-206 kubenswrapper[2575]: E0723 23:07:38.494955 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7662-139691542462800\" is forbidden: User \"system:node:ip-10-0-134-206.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-206.ec2.internal' and this object" podUID="4bf62d38-245c-432f-a92a-ac26fceb729e" pod="opendatahub/test-curl-7662-139691542462800" Jul 23 23:07:38.499812 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:38.499793 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:07:38.608609 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:38.608588 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:07:38.807222 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:38.807155 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4bf62d38-245c-432f-a92a-ac26fceb729e" path="/var/lib/kubelet/pods/4bf62d38-245c-432f-a92a-ac26fceb729e/volumes" Jul 23 23:07:41.609808 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:41.609781 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:07:41.696954 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:41.696918 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:07:41.752304 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:41.752277 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:07:41.904269 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:41.904201 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:07:42.252364 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:42.252329 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:07:42.347744 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:42.347712 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:07:42.353940 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:42.353913 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-4b3ef9-6f56c9df6d-57fqn"] Jul 23 23:07:42.354378 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:42.354363 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4bf62d38-245c-432f-a92a-ac26fceb729e" containerName="test-curl-7662-139691542462800" Jul 23 23:07:42.354418 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:42.354380 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bf62d38-245c-432f-a92a-ac26fceb729e" containerName="test-curl-7662-139691542462800" Jul 23 23:07:42.354450 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:42.354443 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="4bf62d38-245c-432f-a92a-ac26fceb729e" containerName="test-curl-7662-139691542462800" Jul 23 23:07:42.359700 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:42.359682 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-4b3ef9-6f56c9df6d-57fqn" Jul 23 23:07:42.362168 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:42.362144 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-4b3ef9\"" Jul 23 23:07:42.362708 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:42.362674 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-4b3ef9-dockercfg-kpnqk\"" Jul 23 23:07:42.365500 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:42.365473 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-4b3ef9-6f56c9df6d-57fqn"] Jul 23 23:07:42.381790 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:42.381751 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drmg2\" (UniqueName: \"kubernetes.io/projected/4820ea4c-b792-4dd3-be25-acfb9a13a803-kube-api-access-drmg2\") pod \"payload-pre-processing-e2e-ipp-a-4b3ef9-6f56c9df6d-57fqn\" (UID: \"4820ea4c-b792-4dd3-be25-acfb9a13a803\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-4b3ef9-6f56c9df6d-57fqn" Jul 23 23:07:42.381956 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:42.381867 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4820ea4c-b792-4dd3-be25-acfb9a13a803-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-4b3ef9-6f56c9df6d-57fqn\" (UID: \"4820ea4c-b792-4dd3-be25-acfb9a13a803\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-4b3ef9-6f56c9df6d-57fqn" Jul 23 23:07:42.386860 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:42.386833 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-4b3ef9-6474cd98d4-wt6bs"] Jul 23 23:07:42.390770 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:42.390751 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-4b3ef9-6474cd98d4-wt6bs" Jul 23 23:07:42.402859 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:42.402833 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-4b3ef9-6474cd98d4-wt6bs"] Jul 23 23:07:42.483380 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:42.483345 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4820ea4c-b792-4dd3-be25-acfb9a13a803-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-4b3ef9-6f56c9df6d-57fqn\" (UID: \"4820ea4c-b792-4dd3-be25-acfb9a13a803\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-4b3ef9-6f56c9df6d-57fqn" Jul 23 23:07:42.483536 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:42.483441 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsqgq\" (UniqueName: \"kubernetes.io/projected/1d57dba4-e5dd-4175-8a0d-f8d5640802dd-kube-api-access-rsqgq\") pod \"payload-processing-e2e-ipp-a-4b3ef9-6474cd98d4-wt6bs\" (UID: \"1d57dba4-e5dd-4175-8a0d-f8d5640802dd\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-4b3ef9-6474cd98d4-wt6bs" Jul 23 23:07:42.483536 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:42.483499 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1d57dba4-e5dd-4175-8a0d-f8d5640802dd-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-4b3ef9-6474cd98d4-wt6bs\" (UID: \"1d57dba4-e5dd-4175-8a0d-f8d5640802dd\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-4b3ef9-6474cd98d4-wt6bs" Jul 23 23:07:42.483609 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:42.483580 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drmg2\" (UniqueName: \"kubernetes.io/projected/4820ea4c-b792-4dd3-be25-acfb9a13a803-kube-api-access-drmg2\") pod \"payload-pre-processing-e2e-ipp-a-4b3ef9-6f56c9df6d-57fqn\" (UID: \"4820ea4c-b792-4dd3-be25-acfb9a13a803\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-4b3ef9-6f56c9df6d-57fqn" Jul 23 23:07:42.484170 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:42.484151 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4820ea4c-b792-4dd3-be25-acfb9a13a803-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-4b3ef9-6f56c9df6d-57fqn\" (UID: \"4820ea4c-b792-4dd3-be25-acfb9a13a803\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-4b3ef9-6f56c9df6d-57fqn" Jul 23 23:07:42.491347 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:42.491329 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-drmg2\" (UniqueName: \"kubernetes.io/projected/4820ea4c-b792-4dd3-be25-acfb9a13a803-kube-api-access-drmg2\") pod \"payload-pre-processing-e2e-ipp-a-4b3ef9-6f56c9df6d-57fqn\" (UID: \"4820ea4c-b792-4dd3-be25-acfb9a13a803\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-4b3ef9-6f56c9df6d-57fqn" Jul 23 23:07:42.585125 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:42.585047 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsqgq\" (UniqueName: \"kubernetes.io/projected/1d57dba4-e5dd-4175-8a0d-f8d5640802dd-kube-api-access-rsqgq\") pod \"payload-processing-e2e-ipp-a-4b3ef9-6474cd98d4-wt6bs\" (UID: \"1d57dba4-e5dd-4175-8a0d-f8d5640802dd\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-4b3ef9-6474cd98d4-wt6bs" Jul 23 23:07:42.585125 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:42.585103 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1d57dba4-e5dd-4175-8a0d-f8d5640802dd-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-4b3ef9-6474cd98d4-wt6bs\" (UID: \"1d57dba4-e5dd-4175-8a0d-f8d5640802dd\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-4b3ef9-6474cd98d4-wt6bs" Jul 23 23:07:42.585754 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:42.585731 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1d57dba4-e5dd-4175-8a0d-f8d5640802dd-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-4b3ef9-6474cd98d4-wt6bs\" (UID: \"1d57dba4-e5dd-4175-8a0d-f8d5640802dd\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-4b3ef9-6474cd98d4-wt6bs" Jul 23 23:07:42.593852 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:42.593828 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsqgq\" (UniqueName: \"kubernetes.io/projected/1d57dba4-e5dd-4175-8a0d-f8d5640802dd-kube-api-access-rsqgq\") pod \"payload-processing-e2e-ipp-a-4b3ef9-6474cd98d4-wt6bs\" (UID: \"1d57dba4-e5dd-4175-8a0d-f8d5640802dd\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-4b3ef9-6474cd98d4-wt6bs" Jul 23 23:07:42.671629 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:42.671592 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-4b3ef9-6f56c9df6d-57fqn" Jul 23 23:07:42.702571 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:42.702410 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-4b3ef9-6474cd98d4-wt6bs" Jul 23 23:07:42.831155 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:42.831125 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-4b3ef9-6f56c9df6d-57fqn"] Jul 23 23:07:42.832067 ip-10-0-134-206 kubenswrapper[2575]: W0723 23:07:42.832005 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4820ea4c_b792_4dd3_be25_acfb9a13a803.slice/crio-856c0047be824d07c19b522607eda3b60b10ba79af7f452607376f8bd4e0f421 WatchSource:0}: Error finding container 856c0047be824d07c19b522607eda3b60b10ba79af7f452607376f8bd4e0f421: Status 404 returned error can't find the container with id 856c0047be824d07c19b522607eda3b60b10ba79af7f452607376f8bd4e0f421 Jul 23 23:07:42.870462 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:42.870439 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-4b3ef9-6474cd98d4-wt6bs"] Jul 23 23:07:42.874396 ip-10-0-134-206 kubenswrapper[2575]: W0723 23:07:42.874357 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d57dba4_e5dd_4175_8a0d_f8d5640802dd.slice/crio-419694db2c6c455f9b7ff1faa8ab9d8002fa7b4536f68f572e4be353155774fb WatchSource:0}: Error finding container 419694db2c6c455f9b7ff1faa8ab9d8002fa7b4536f68f572e4be353155774fb: Status 404 returned error can't find the container with id 419694db2c6c455f9b7ff1faa8ab9d8002fa7b4536f68f572e4be353155774fb Jul 23 23:07:43.515443 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:43.515371 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-4b3ef9-6f56c9df6d-57fqn" event={"ID":"4820ea4c-b792-4dd3-be25-acfb9a13a803","Type":"ContainerStarted","Data":"7bd146517352b40a1d5173676f36b84e1ef5b26bdd68bb73baacc951494de754"} Jul 23 23:07:43.515443 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:43.515447 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-4b3ef9-6f56c9df6d-57fqn" Jul 23 23:07:43.515678 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:43.515476 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-4b3ef9-6f56c9df6d-57fqn" event={"ID":"4820ea4c-b792-4dd3-be25-acfb9a13a803","Type":"ContainerStarted","Data":"856c0047be824d07c19b522607eda3b60b10ba79af7f452607376f8bd4e0f421"} Jul 23 23:07:43.516992 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:43.516967 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-4b3ef9-6474cd98d4-wt6bs" event={"ID":"1d57dba4-e5dd-4175-8a0d-f8d5640802dd","Type":"ContainerStarted","Data":"023638b109284f216b67e02c063b558b345b9b6b25fc4be854af00c818c4e005"} Jul 23 23:07:43.517135 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:43.517010 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-4b3ef9-6474cd98d4-wt6bs" event={"ID":"1d57dba4-e5dd-4175-8a0d-f8d5640802dd","Type":"ContainerStarted","Data":"419694db2c6c455f9b7ff1faa8ab9d8002fa7b4536f68f572e4be353155774fb"} Jul 23 23:07:43.517135 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:43.517049 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-4b3ef9-6474cd98d4-wt6bs" Jul 23 23:07:43.531102 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:43.531059 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-4b3ef9-6f56c9df6d-57fqn" podStartSLOduration=1.531042631 podStartE2EDuration="1.531042631s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 23:07:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 23:07:43.530042204 +0000 UTC m=+2691.250039455" watchObservedRunningTime="2026-07-23 23:07:43.531042631 +0000 UTC m=+2691.251039900" Jul 23 23:07:43.545344 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:43.545290 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-4b3ef9-6474cd98d4-wt6bs" podStartSLOduration=1.545270269 podStartE2EDuration="1.545270269s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 23:07:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 23:07:43.543497228 +0000 UTC m=+2691.263494492" watchObservedRunningTime="2026-07-23 23:07:43.545270269 +0000 UTC m=+2691.265267530" Jul 23 23:07:46.169539 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:46.169470 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:07:54.524247 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:54.524194 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-4b3ef9-6f56c9df6d-57fqn" Jul 23 23:07:54.524699 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:54.524323 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-4b3ef9-6474cd98d4-wt6bs" Jul 23 23:07:57.128281 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:57.128232 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:07:57.423533 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:57.423498 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4"] Jul 23 23:07:57.428753 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:57.428731 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4" Jul 23 23:07:57.431642 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:57.431620 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 23 23:07:57.431775 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:57.431733 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-4f67fa-openshift-default-dockercfg-jmbqn\"" Jul 23 23:07:57.449179 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:57.449152 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4"] Jul 23 23:07:57.466567 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:57.466531 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:07:57.515898 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:57.515863 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62b6e412-3610-4dd3-9d90-f254055650eb-workload-socket\") pod \"e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4\" (UID: \"62b6e412-3610-4dd3-9d90-f254055650eb\") " pod="openshift-ingress/e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4" Jul 23 23:07:57.515898 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:57.515895 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62b6e412-3610-4dd3-9d90-f254055650eb-istio-podinfo\") pod \"e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4\" (UID: \"62b6e412-3610-4dd3-9d90-f254055650eb\") " pod="openshift-ingress/e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4" Jul 23 23:07:57.516107 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:57.515916 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62b6e412-3610-4dd3-9d90-f254055650eb-workload-certs\") pod \"e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4\" (UID: \"62b6e412-3610-4dd3-9d90-f254055650eb\") " pod="openshift-ingress/e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4" Jul 23 23:07:57.516107 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:57.516079 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdq24\" (UniqueName: \"kubernetes.io/projected/62b6e412-3610-4dd3-9d90-f254055650eb-kube-api-access-bdq24\") pod \"e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4\" (UID: \"62b6e412-3610-4dd3-9d90-f254055650eb\") " pod="openshift-ingress/e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4" Jul 23 23:07:57.516177 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:57.516107 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62b6e412-3610-4dd3-9d90-f254055650eb-credential-socket\") pod \"e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4\" (UID: \"62b6e412-3610-4dd3-9d90-f254055650eb\") " pod="openshift-ingress/e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4" Jul 23 23:07:57.516177 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:57.516130 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62b6e412-3610-4dd3-9d90-f254055650eb-istio-data\") pod \"e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4\" (UID: \"62b6e412-3610-4dd3-9d90-f254055650eb\") " pod="openshift-ingress/e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4" Jul 23 23:07:57.516177 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:57.516151 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62b6e412-3610-4dd3-9d90-f254055650eb-istio-token\") pod \"e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4\" (UID: \"62b6e412-3610-4dd3-9d90-f254055650eb\") " pod="openshift-ingress/e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4" Jul 23 23:07:57.516177 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:57.516175 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62b6e412-3610-4dd3-9d90-f254055650eb-istiod-ca-cert\") pod \"e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4\" (UID: \"62b6e412-3610-4dd3-9d90-f254055650eb\") " pod="openshift-ingress/e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4" Jul 23 23:07:57.516314 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:57.516216 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62b6e412-3610-4dd3-9d90-f254055650eb-istio-envoy\") pod \"e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4\" (UID: \"62b6e412-3610-4dd3-9d90-f254055650eb\") " pod="openshift-ingress/e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4" Jul 23 23:07:57.567612 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:57.567578 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:07:57.617433 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:57.617398 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdq24\" (UniqueName: \"kubernetes.io/projected/62b6e412-3610-4dd3-9d90-f254055650eb-kube-api-access-bdq24\") pod \"e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4\" (UID: \"62b6e412-3610-4dd3-9d90-f254055650eb\") " pod="openshift-ingress/e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4" Jul 23 23:07:57.617433 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:57.617431 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62b6e412-3610-4dd3-9d90-f254055650eb-credential-socket\") pod \"e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4\" (UID: \"62b6e412-3610-4dd3-9d90-f254055650eb\") " pod="openshift-ingress/e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4" Jul 23 23:07:57.617782 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:57.617449 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62b6e412-3610-4dd3-9d90-f254055650eb-istio-data\") pod \"e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4\" (UID: \"62b6e412-3610-4dd3-9d90-f254055650eb\") " pod="openshift-ingress/e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4" Jul 23 23:07:57.617782 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:57.617489 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62b6e412-3610-4dd3-9d90-f254055650eb-istio-token\") pod \"e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4\" (UID: \"62b6e412-3610-4dd3-9d90-f254055650eb\") " pod="openshift-ingress/e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4" Jul 23 23:07:57.617782 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:57.617529 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62b6e412-3610-4dd3-9d90-f254055650eb-istiod-ca-cert\") pod \"e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4\" (UID: \"62b6e412-3610-4dd3-9d90-f254055650eb\") " pod="openshift-ingress/e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4" Jul 23 23:07:57.617782 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:57.617572 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62b6e412-3610-4dd3-9d90-f254055650eb-istio-envoy\") pod \"e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4\" (UID: \"62b6e412-3610-4dd3-9d90-f254055650eb\") " pod="openshift-ingress/e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4" Jul 23 23:07:57.617782 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:57.617625 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62b6e412-3610-4dd3-9d90-f254055650eb-workload-socket\") pod \"e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4\" (UID: \"62b6e412-3610-4dd3-9d90-f254055650eb\") " pod="openshift-ingress/e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4" Jul 23 23:07:57.617782 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:57.617641 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62b6e412-3610-4dd3-9d90-f254055650eb-istio-podinfo\") pod \"e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4\" (UID: \"62b6e412-3610-4dd3-9d90-f254055650eb\") " pod="openshift-ingress/e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4" Jul 23 23:07:57.617782 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:57.617666 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62b6e412-3610-4dd3-9d90-f254055650eb-workload-certs\") pod \"e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4\" (UID: \"62b6e412-3610-4dd3-9d90-f254055650eb\") " pod="openshift-ingress/e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4" Jul 23 23:07:57.618158 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:57.617840 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62b6e412-3610-4dd3-9d90-f254055650eb-credential-socket\") pod \"e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4\" (UID: \"62b6e412-3610-4dd3-9d90-f254055650eb\") " pod="openshift-ingress/e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4" Jul 23 23:07:57.618158 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:57.617963 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62b6e412-3610-4dd3-9d90-f254055650eb-istio-data\") pod \"e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4\" (UID: \"62b6e412-3610-4dd3-9d90-f254055650eb\") " pod="openshift-ingress/e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4" Jul 23 23:07:57.618158 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:57.618041 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62b6e412-3610-4dd3-9d90-f254055650eb-workload-socket\") pod \"e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4\" (UID: \"62b6e412-3610-4dd3-9d90-f254055650eb\") " pod="openshift-ingress/e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4" Jul 23 23:07:57.618158 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:57.618113 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62b6e412-3610-4dd3-9d90-f254055650eb-workload-certs\") pod \"e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4\" (UID: \"62b6e412-3610-4dd3-9d90-f254055650eb\") " pod="openshift-ingress/e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4" Jul 23 23:07:57.618298 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:57.618234 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62b6e412-3610-4dd3-9d90-f254055650eb-istiod-ca-cert\") pod \"e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4\" (UID: \"62b6e412-3610-4dd3-9d90-f254055650eb\") " pod="openshift-ingress/e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4" Jul 23 23:07:57.619871 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:57.619851 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62b6e412-3610-4dd3-9d90-f254055650eb-istio-envoy\") pod \"e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4\" (UID: \"62b6e412-3610-4dd3-9d90-f254055650eb\") " pod="openshift-ingress/e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4" Jul 23 23:07:57.620100 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:57.620083 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62b6e412-3610-4dd3-9d90-f254055650eb-istio-podinfo\") pod \"e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4\" (UID: \"62b6e412-3610-4dd3-9d90-f254055650eb\") " pod="openshift-ingress/e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4" Jul 23 23:07:57.625000 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:57.624975 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62b6e412-3610-4dd3-9d90-f254055650eb-istio-token\") pod \"e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4\" (UID: \"62b6e412-3610-4dd3-9d90-f254055650eb\") " pod="openshift-ingress/e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4" Jul 23 23:07:57.625146 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:57.625047 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdq24\" (UniqueName: \"kubernetes.io/projected/62b6e412-3610-4dd3-9d90-f254055650eb-kube-api-access-bdq24\") pod \"e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4\" (UID: \"62b6e412-3610-4dd3-9d90-f254055650eb\") " pod="openshift-ingress/e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4" Jul 23 23:07:57.739672 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:57.739590 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4" Jul 23 23:07:57.884395 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:57.884363 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4"] Jul 23 23:07:57.885441 ip-10-0-134-206 kubenswrapper[2575]: W0723 23:07:57.885410 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62b6e412_3610_4dd3_9d90_f254055650eb.slice/crio-a1b7549cffe8468e6d3816fe9c7a891dc391fc3e247e6727f9355f2022e5d1e7 WatchSource:0}: Error finding container a1b7549cffe8468e6d3816fe9c7a891dc391fc3e247e6727f9355f2022e5d1e7: Status 404 returned error can't find the container with id a1b7549cffe8468e6d3816fe9c7a891dc391fc3e247e6727f9355f2022e5d1e7 Jul 23 23:07:58.605398 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:07:58.605361 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4" event={"ID":"62b6e412-3610-4dd3-9d90-f254055650eb","Type":"ContainerStarted","Data":"a1b7549cffe8468e6d3816fe9c7a891dc391fc3e247e6727f9355f2022e5d1e7"} Jul 23 23:08:01.077890 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:08:01.077856 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 23 23:08:01.078166 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:08:01.077924 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 23 23:08:01.078166 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:08:01.077951 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 23 23:08:01.627357 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:08:01.627315 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4" event={"ID":"62b6e412-3610-4dd3-9d90-f254055650eb","Type":"ContainerStarted","Data":"ee7ebfae4ef084440dcf7f650df9821f1a801de864146a6ceec43a4a643d2231"} Jul 23 23:08:01.646207 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:08:01.646143 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4" podStartSLOduration=1.456140189 podStartE2EDuration="4.646121462s" totalImagesPullingTime="3.189981273s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 23:07:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 23:08:01.645714951 +0000 UTC m=+2709.365712212" watchObservedRunningTime="2026-07-23 23:08:01.646121462 +0000 UTC m=+2709.366118724" Jul 23 23:08:01.739691 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:08:01.739652 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4" Jul 23 23:08:02.746037 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:08:02.745987 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4" Jul 23 23:08:03.576781 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:08:03.576734 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:08:03.641426 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:08:03.641396 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4" Jul 23 23:08:03.642443 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:08:03.642422 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4" Jul 23 23:08:03.671145 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:08:03.671117 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:08:03.834257 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:08:03.834179 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:08:03.933714 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:08:03.933682 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:08:04.297308 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:08:04.297273 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:08:04.398447 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:08:04.398413 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:08:08.135779 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:08:08.135746 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:08:16.720527 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:08:16.720486 2575 generic.go:356] "Generic (PLEG): container finished" podID="62b6e412-3610-4dd3-9d90-f254055650eb" containerID="ee7ebfae4ef084440dcf7f650df9821f1a801de864146a6ceec43a4a643d2231" exitCode=0 Jul 23 23:08:16.720954 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:08:16.720557 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4" event={"ID":"62b6e412-3610-4dd3-9d90-f254055650eb","Type":"ContainerDied","Data":"ee7ebfae4ef084440dcf7f650df9821f1a801de864146a6ceec43a4a643d2231"} Jul 23 23:08:16.720954 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:08:16.720945 2575 scope.go:117] "RemoveContainer" containerID="ee7ebfae4ef084440dcf7f650df9821f1a801de864146a6ceec43a4a643d2231" Jul 23 23:08:16.722937 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:08:16.722908 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 23 23:08:16.723011 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:08:16.723000 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 23 23:08:16.723065 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:08:16.723045 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 23 23:08:17.727984 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:08:17.727945 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4" event={"ID":"62b6e412-3610-4dd3-9d90-f254055650eb","Type":"ContainerStarted","Data":"0878393e614a4f65547efacff5ea294f78e993a7da8aefa9e755fb557fcf7538"} Jul 23 23:08:17.740282 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:08:17.740237 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4" Jul 23 23:08:17.741441 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:08:17.741409 2575 patch_prober.go:28] interesting pod/e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body= Jul 23 23:08:17.741574 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:08:17.741466 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4" podUID="62b6e412-3610-4dd3-9d90-f254055650eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" Jul 23 23:08:18.642378 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:08:18.642300 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4" Jul 23 23:08:18.758046 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:08:18.751616 2575 patch_prober.go:28] interesting pod/e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body= Jul 23 23:08:18.758046 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:08:18.751678 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4" podUID="62b6e412-3610-4dd3-9d90-f254055650eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" Jul 23 23:08:19.742211 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:08:19.740094 2575 patch_prober.go:28] interesting pod/e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body= Jul 23 23:08:19.742211 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:08:19.740158 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4" podUID="62b6e412-3610-4dd3-9d90-f254055650eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" Jul 23 23:08:20.740928 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:08:20.740886 2575 patch_prober.go:28] interesting pod/e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body= Jul 23 23:08:20.741421 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:08:20.740956 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4" podUID="62b6e412-3610-4dd3-9d90-f254055650eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" Jul 23 23:08:21.744473 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:08:21.744441 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4" Jul 23 23:08:21.745372 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:08:21.745352 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4" Jul 23 23:08:25.409802 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:08:25.409767 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-9wvrc_a5b6a8f7-a06a-4a1a-a4c8-19fe6713282c/payload-processing/0.log" Jul 23 23:08:36.001882 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:08:36.001851 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:08:56.429140 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:08:56.429102 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:09:09.451232 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:09.451200 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-4b3ef9-6474cd98d4-wt6bs_1d57dba4-e5dd-4175-8a0d-f8d5640802dd/payload-processing/0.log" Jul 23 23:09:09.576521 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:09.576493 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-9wvrc_a5b6a8f7-a06a-4a1a-a4c8-19fe6713282c/payload-processing/0.log" Jul 23 23:09:09.989680 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:09.989642 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:09:10.288563 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:10.288484 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c"] Jul 23 23:09:10.292137 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:10.292119 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c" Jul 23 23:09:10.294638 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:10.294614 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-8300e5-openshift-default-dockercfg-c527p\"" Jul 23 23:09:10.304997 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:10.304968 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c"] Jul 23 23:09:10.309520 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:10.309494 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:09:10.389521 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:10.389485 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a7f9028-e494-4ed3-a321-18747f8c5910-istio-data\") pod \"e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c\" (UID: \"6a7f9028-e494-4ed3-a321-18747f8c5910\") " pod="openshift-ingress/e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c" Jul 23 23:09:10.389709 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:10.389540 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czvm6\" (UniqueName: \"kubernetes.io/projected/6a7f9028-e494-4ed3-a321-18747f8c5910-kube-api-access-czvm6\") pod \"e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c\" (UID: \"6a7f9028-e494-4ed3-a321-18747f8c5910\") " pod="openshift-ingress/e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c" Jul 23 23:09:10.389709 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:10.389600 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a7f9028-e494-4ed3-a321-18747f8c5910-workload-certs\") pod \"e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c\" (UID: \"6a7f9028-e494-4ed3-a321-18747f8c5910\") " pod="openshift-ingress/e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c" Jul 23 23:09:10.389709 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:10.389623 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a7f9028-e494-4ed3-a321-18747f8c5910-istio-token\") pod \"e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c\" (UID: \"6a7f9028-e494-4ed3-a321-18747f8c5910\") " pod="openshift-ingress/e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c" Jul 23 23:09:10.389709 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:10.389658 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a7f9028-e494-4ed3-a321-18747f8c5910-istio-envoy\") pod \"e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c\" (UID: \"6a7f9028-e494-4ed3-a321-18747f8c5910\") " pod="openshift-ingress/e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c" Jul 23 23:09:10.389868 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:10.389732 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a7f9028-e494-4ed3-a321-18747f8c5910-workload-socket\") pod \"e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c\" (UID: \"6a7f9028-e494-4ed3-a321-18747f8c5910\") " pod="openshift-ingress/e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c" Jul 23 23:09:10.389868 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:10.389770 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a7f9028-e494-4ed3-a321-18747f8c5910-istiod-ca-cert\") pod \"e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c\" (UID: \"6a7f9028-e494-4ed3-a321-18747f8c5910\") " pod="openshift-ingress/e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c" Jul 23 23:09:10.389868 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:10.389851 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a7f9028-e494-4ed3-a321-18747f8c5910-credential-socket\") pod \"e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c\" (UID: \"6a7f9028-e494-4ed3-a321-18747f8c5910\") " pod="openshift-ingress/e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c" Jul 23 23:09:10.389982 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:10.389894 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a7f9028-e494-4ed3-a321-18747f8c5910-istio-podinfo\") pod \"e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c\" (UID: \"6a7f9028-e494-4ed3-a321-18747f8c5910\") " pod="openshift-ingress/e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c" Jul 23 23:09:10.408283 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:10.408241 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:09:10.491073 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:10.491009 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a7f9028-e494-4ed3-a321-18747f8c5910-istio-podinfo\") pod \"e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c\" (UID: \"6a7f9028-e494-4ed3-a321-18747f8c5910\") " pod="openshift-ingress/e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c" Jul 23 23:09:10.491522 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:10.491089 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a7f9028-e494-4ed3-a321-18747f8c5910-istio-data\") pod \"e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c\" (UID: \"6a7f9028-e494-4ed3-a321-18747f8c5910\") " pod="openshift-ingress/e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c" Jul 23 23:09:10.491522 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:10.491138 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czvm6\" (UniqueName: \"kubernetes.io/projected/6a7f9028-e494-4ed3-a321-18747f8c5910-kube-api-access-czvm6\") pod \"e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c\" (UID: \"6a7f9028-e494-4ed3-a321-18747f8c5910\") " pod="openshift-ingress/e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c" Jul 23 23:09:10.491522 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:10.491184 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a7f9028-e494-4ed3-a321-18747f8c5910-workload-certs\") pod \"e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c\" (UID: \"6a7f9028-e494-4ed3-a321-18747f8c5910\") " pod="openshift-ingress/e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c" Jul 23 23:09:10.491522 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:10.491201 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a7f9028-e494-4ed3-a321-18747f8c5910-istio-token\") pod \"e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c\" (UID: \"6a7f9028-e494-4ed3-a321-18747f8c5910\") " pod="openshift-ingress/e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c" Jul 23 23:09:10.491522 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:10.491236 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a7f9028-e494-4ed3-a321-18747f8c5910-istio-envoy\") pod \"e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c\" (UID: \"6a7f9028-e494-4ed3-a321-18747f8c5910\") " pod="openshift-ingress/e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c" Jul 23 23:09:10.491522 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:10.491393 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a7f9028-e494-4ed3-a321-18747f8c5910-workload-socket\") pod \"e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c\" (UID: \"6a7f9028-e494-4ed3-a321-18747f8c5910\") " pod="openshift-ingress/e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c" Jul 23 23:09:10.491522 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:10.491475 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a7f9028-e494-4ed3-a321-18747f8c5910-istiod-ca-cert\") pod \"e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c\" (UID: \"6a7f9028-e494-4ed3-a321-18747f8c5910\") " pod="openshift-ingress/e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c" Jul 23 23:09:10.491522 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:10.491496 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a7f9028-e494-4ed3-a321-18747f8c5910-istio-data\") pod \"e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c\" (UID: \"6a7f9028-e494-4ed3-a321-18747f8c5910\") " pod="openshift-ingress/e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c" Jul 23 23:09:10.491869 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:10.491535 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a7f9028-e494-4ed3-a321-18747f8c5910-credential-socket\") pod \"e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c\" (UID: \"6a7f9028-e494-4ed3-a321-18747f8c5910\") " pod="openshift-ingress/e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c" Jul 23 23:09:10.491869 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:10.491587 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a7f9028-e494-4ed3-a321-18747f8c5910-workload-certs\") pod \"e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c\" (UID: \"6a7f9028-e494-4ed3-a321-18747f8c5910\") " pod="openshift-ingress/e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c" Jul 23 23:09:10.491869 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:10.491708 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a7f9028-e494-4ed3-a321-18747f8c5910-workload-socket\") pod \"e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c\" (UID: \"6a7f9028-e494-4ed3-a321-18747f8c5910\") " pod="openshift-ingress/e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c" Jul 23 23:09:10.491869 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:10.491845 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a7f9028-e494-4ed3-a321-18747f8c5910-credential-socket\") pod \"e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c\" (UID: \"6a7f9028-e494-4ed3-a321-18747f8c5910\") " pod="openshift-ingress/e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c" Jul 23 23:09:10.492096 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:10.492079 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a7f9028-e494-4ed3-a321-18747f8c5910-istiod-ca-cert\") pod \"e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c\" (UID: \"6a7f9028-e494-4ed3-a321-18747f8c5910\") " pod="openshift-ingress/e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c" Jul 23 23:09:10.493611 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:10.493592 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a7f9028-e494-4ed3-a321-18747f8c5910-istio-podinfo\") pod \"e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c\" (UID: \"6a7f9028-e494-4ed3-a321-18747f8c5910\") " pod="openshift-ingress/e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c" Jul 23 23:09:10.493720 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:10.493662 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a7f9028-e494-4ed3-a321-18747f8c5910-istio-envoy\") pod \"e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c\" (UID: \"6a7f9028-e494-4ed3-a321-18747f8c5910\") " pod="openshift-ingress/e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c" Jul 23 23:09:10.505628 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:10.505605 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a7f9028-e494-4ed3-a321-18747f8c5910-istio-token\") pod \"e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c\" (UID: \"6a7f9028-e494-4ed3-a321-18747f8c5910\") " pod="openshift-ingress/e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c" Jul 23 23:09:10.505872 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:10.505851 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-czvm6\" (UniqueName: \"kubernetes.io/projected/6a7f9028-e494-4ed3-a321-18747f8c5910-kube-api-access-czvm6\") pod \"e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c\" (UID: \"6a7f9028-e494-4ed3-a321-18747f8c5910\") " pod="openshift-ingress/e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c" Jul 23 23:09:10.604075 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:10.603999 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c" Jul 23 23:09:10.747510 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:10.747481 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c"] Jul 23 23:09:10.749375 ip-10-0-134-206 kubenswrapper[2575]: W0723 23:09:10.749347 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a7f9028_e494_4ed3_a321_18747f8c5910.slice/crio-87b6efe69150eba7c8182e1d2c7a002d847ada6f3a05e15db43329be9602a9aa WatchSource:0}: Error finding container 87b6efe69150eba7c8182e1d2c7a002d847ada6f3a05e15db43329be9602a9aa: Status 404 returned error can't find the container with id 87b6efe69150eba7c8182e1d2c7a002d847ada6f3a05e15db43329be9602a9aa Jul 23 23:09:10.751724 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:10.751690 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 23 23:09:10.751803 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:10.751755 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 23 23:09:10.751803 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:10.751784 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 23 23:09:11.061774 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:11.061739 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c" event={"ID":"6a7f9028-e494-4ed3-a321-18747f8c5910","Type":"ContainerStarted","Data":"d028e93983c93c868d41cc339494b8a68cbed18b3dad74b12167810ca28cf776"} Jul 23 23:09:11.061953 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:11.061794 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c" event={"ID":"6a7f9028-e494-4ed3-a321-18747f8c5910","Type":"ContainerStarted","Data":"87b6efe69150eba7c8182e1d2c7a002d847ada6f3a05e15db43329be9602a9aa"} Jul 23 23:09:11.081480 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:11.081429 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c" podStartSLOduration=1.0814132459999999 podStartE2EDuration="1.081413246s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 23:09:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 23:09:11.078557307 +0000 UTC m=+2778.798554567" watchObservedRunningTime="2026-07-23 23:09:11.081413246 +0000 UTC m=+2778.801410506" Jul 23 23:09:11.605082 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:11.605047 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c" Jul 23 23:09:11.609974 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:11.609952 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c" Jul 23 23:09:12.068426 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:12.068392 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c" Jul 23 23:09:12.069228 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:12.069204 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c" Jul 23 23:09:13.019885 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:13.019852 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:09:13.119013 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:13.118988 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:09:13.223795 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:13.223767 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:09:13.618953 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:13.618920 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:09:13.719444 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:13.719418 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:09:13.779466 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:13.779435 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:09:17.538892 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:17.538812 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:09:27.070077 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:27.070016 2575 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body= Jul 23 23:09:27.070518 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:27.070106 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c" podUID="6a7f9028-e494-4ed3-a321-18747f8c5910" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" Jul 23 23:09:27.162461 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:27.162426 2575 generic.go:356] "Generic (PLEG): container finished" podID="6a7f9028-e494-4ed3-a321-18747f8c5910" containerID="d028e93983c93c868d41cc339494b8a68cbed18b3dad74b12167810ca28cf776" exitCode=0 Jul 23 23:09:27.162637 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:27.162481 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c" event={"ID":"6a7f9028-e494-4ed3-a321-18747f8c5910","Type":"ContainerDied","Data":"d028e93983c93c868d41cc339494b8a68cbed18b3dad74b12167810ca28cf776"} Jul 23 23:09:27.162920 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:27.162900 2575 scope.go:117] "RemoveContainer" containerID="d028e93983c93c868d41cc339494b8a68cbed18b3dad74b12167810ca28cf776" Jul 23 23:09:27.164084 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:27.164050 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 23 23:09:27.164173 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:27.164120 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 23 23:09:27.164173 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:27.164150 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jul 23 23:09:28.172955 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:28.172923 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c" event={"ID":"6a7f9028-e494-4ed3-a321-18747f8c5910","Type":"ContainerStarted","Data":"7152ca96470fe18098574d3d70e07ba3caf0b22750ee768c852b581572fea7e8"} Jul 23 23:09:28.605239 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:28.605150 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c" Jul 23 23:09:28.605393 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:28.605333 2575 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body= Jul 23 23:09:28.605393 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:28.605377 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c" podUID="6a7f9028-e494-4ed3-a321-18747f8c5910" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" Jul 23 23:09:29.604895 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:29.604858 2575 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body= Jul 23 23:09:29.605402 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:29.604912 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c" podUID="6a7f9028-e494-4ed3-a321-18747f8c5910" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" Jul 23 23:09:30.604686 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:30.604651 2575 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body= Jul 23 23:09:30.604868 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:30.604705 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c" podUID="6a7f9028-e494-4ed3-a321-18747f8c5910" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" Jul 23 23:09:31.604336 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:31.604302 2575 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body= Jul 23 23:09:31.604702 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:31.604356 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c" podUID="6a7f9028-e494-4ed3-a321-18747f8c5910" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" Jul 23 23:09:32.608911 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:32.608870 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c" Jul 23 23:09:32.609375 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:32.609279 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c" Jul 23 23:09:32.610401 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:32.610376 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c" Jul 23 23:09:39.011188 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:39.011074 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:09:39.079677 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:39.079650 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:09:43.561374 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:43.561338 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:09:43.946184 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:43.946150 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:09:49.698369 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:49.698334 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:09:49.751178 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:49.751149 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:09:49.965895 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:49.965795 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c"] Jul 23 23:09:49.966093 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:49.966065 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c" podUID="6a7f9028-e494-4ed3-a321-18747f8c5910" containerName="istio-proxy" containerID="cri-o://7152ca96470fe18098574d3d70e07ba3caf0b22750ee768c852b581572fea7e8" gracePeriod=30 Jul 23 23:09:49.985227 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:49.985185 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:09:50.225870 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:50.225793 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:09:55.225769 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:55.225712 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c" Jul 23 23:09:55.322212 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:55.322182 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a7f9028-e494-4ed3-a321-18747f8c5910-workload-socket\") pod \"6a7f9028-e494-4ed3-a321-18747f8c5910\" (UID: \"6a7f9028-e494-4ed3-a321-18747f8c5910\") " Jul 23 23:09:55.322368 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:55.322233 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a7f9028-e494-4ed3-a321-18747f8c5910-workload-certs\") pod \"6a7f9028-e494-4ed3-a321-18747f8c5910\" (UID: \"6a7f9028-e494-4ed3-a321-18747f8c5910\") " Jul 23 23:09:55.322368 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:55.322270 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-czvm6\" (UniqueName: \"kubernetes.io/projected/6a7f9028-e494-4ed3-a321-18747f8c5910-kube-api-access-czvm6\") pod \"6a7f9028-e494-4ed3-a321-18747f8c5910\" (UID: \"6a7f9028-e494-4ed3-a321-18747f8c5910\") " Jul 23 23:09:55.322368 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:55.322300 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a7f9028-e494-4ed3-a321-18747f8c5910-credential-socket\") pod \"6a7f9028-e494-4ed3-a321-18747f8c5910\" (UID: \"6a7f9028-e494-4ed3-a321-18747f8c5910\") " Jul 23 23:09:55.322368 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:55.322345 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a7f9028-e494-4ed3-a321-18747f8c5910-istio-envoy\") pod \"6a7f9028-e494-4ed3-a321-18747f8c5910\" (UID: \"6a7f9028-e494-4ed3-a321-18747f8c5910\") " Jul 23 23:09:55.322368 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:55.322367 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a7f9028-e494-4ed3-a321-18747f8c5910-istio-podinfo\") pod \"6a7f9028-e494-4ed3-a321-18747f8c5910\" (UID: \"6a7f9028-e494-4ed3-a321-18747f8c5910\") " Jul 23 23:09:55.322631 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:55.322441 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a7f9028-e494-4ed3-a321-18747f8c5910-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6a7f9028-e494-4ed3-a321-18747f8c5910" (UID: "6a7f9028-e494-4ed3-a321-18747f8c5910"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 23:09:55.322631 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:55.322474 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a7f9028-e494-4ed3-a321-18747f8c5910-istiod-ca-cert\") pod \"6a7f9028-e494-4ed3-a321-18747f8c5910\" (UID: \"6a7f9028-e494-4ed3-a321-18747f8c5910\") " Jul 23 23:09:55.322631 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:55.322508 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a7f9028-e494-4ed3-a321-18747f8c5910-istio-data\") pod \"6a7f9028-e494-4ed3-a321-18747f8c5910\" (UID: \"6a7f9028-e494-4ed3-a321-18747f8c5910\") " Jul 23 23:09:55.322631 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:55.322554 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a7f9028-e494-4ed3-a321-18747f8c5910-istio-token\") pod \"6a7f9028-e494-4ed3-a321-18747f8c5910\" (UID: \"6a7f9028-e494-4ed3-a321-18747f8c5910\") " Jul 23 23:09:55.322631 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:55.322580 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a7f9028-e494-4ed3-a321-18747f8c5910-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6a7f9028-e494-4ed3-a321-18747f8c5910" (UID: "6a7f9028-e494-4ed3-a321-18747f8c5910"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 23:09:55.322631 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:55.322591 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a7f9028-e494-4ed3-a321-18747f8c5910-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6a7f9028-e494-4ed3-a321-18747f8c5910" (UID: "6a7f9028-e494-4ed3-a321-18747f8c5910"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 23:09:55.322914 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:55.322863 2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a7f9028-e494-4ed3-a321-18747f8c5910-workload-socket\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 23:09:55.322914 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:55.322885 2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a7f9028-e494-4ed3-a321-18747f8c5910-workload-certs\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 23:09:55.322914 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:55.322900 2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a7f9028-e494-4ed3-a321-18747f8c5910-credential-socket\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 23:09:55.323074 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:55.322910 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a7f9028-e494-4ed3-a321-18747f8c5910-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6a7f9028-e494-4ed3-a321-18747f8c5910" (UID: "6a7f9028-e494-4ed3-a321-18747f8c5910"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 23:09:55.323584 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:55.323560 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a7f9028-e494-4ed3-a321-18747f8c5910-istio-data" (OuterVolumeSpecName: "istio-data") pod "6a7f9028-e494-4ed3-a321-18747f8c5910" (UID: "6a7f9028-e494-4ed3-a321-18747f8c5910"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 23:09:55.324528 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:55.324500 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a7f9028-e494-4ed3-a321-18747f8c5910-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6a7f9028-e494-4ed3-a321-18747f8c5910" (UID: "6a7f9028-e494-4ed3-a321-18747f8c5910"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 23:09:55.324528 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:55.324513 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a7f9028-e494-4ed3-a321-18747f8c5910-kube-api-access-czvm6" (OuterVolumeSpecName: "kube-api-access-czvm6") pod "6a7f9028-e494-4ed3-a321-18747f8c5910" (UID: "6a7f9028-e494-4ed3-a321-18747f8c5910"). InnerVolumeSpecName "kube-api-access-czvm6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 23:09:55.324810 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:55.324789 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6a7f9028-e494-4ed3-a321-18747f8c5910-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6a7f9028-e494-4ed3-a321-18747f8c5910" (UID: "6a7f9028-e494-4ed3-a321-18747f8c5910"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 23 23:09:55.324852 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:55.324820 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a7f9028-e494-4ed3-a321-18747f8c5910-istio-token" (OuterVolumeSpecName: "istio-token") pod "6a7f9028-e494-4ed3-a321-18747f8c5910" (UID: "6a7f9028-e494-4ed3-a321-18747f8c5910"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 23:09:55.342066 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:55.342039 2575 generic.go:356] "Generic (PLEG): container finished" podID="6a7f9028-e494-4ed3-a321-18747f8c5910" containerID="7152ca96470fe18098574d3d70e07ba3caf0b22750ee768c852b581572fea7e8" exitCode=0 Jul 23 23:09:55.342179 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:55.342082 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c" Jul 23 23:09:55.342179 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:55.342128 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c" event={"ID":"6a7f9028-e494-4ed3-a321-18747f8c5910","Type":"ContainerDied","Data":"7152ca96470fe18098574d3d70e07ba3caf0b22750ee768c852b581572fea7e8"} Jul 23 23:09:55.342297 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:55.342185 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c" event={"ID":"6a7f9028-e494-4ed3-a321-18747f8c5910","Type":"ContainerDied","Data":"87b6efe69150eba7c8182e1d2c7a002d847ada6f3a05e15db43329be9602a9aa"} Jul 23 23:09:55.342297 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:55.342216 2575 scope.go:117] "RemoveContainer" containerID="7152ca96470fe18098574d3d70e07ba3caf0b22750ee768c852b581572fea7e8" Jul 23 23:09:55.352393 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:55.352376 2575 scope.go:117] "RemoveContainer" containerID="d028e93983c93c868d41cc339494b8a68cbed18b3dad74b12167810ca28cf776" Jul 23 23:09:55.361955 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:55.361938 2575 scope.go:117] "RemoveContainer" containerID="7152ca96470fe18098574d3d70e07ba3caf0b22750ee768c852b581572fea7e8" Jul 23 23:09:55.362254 ip-10-0-134-206 kubenswrapper[2575]: E0723 23:09:55.362236 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7152ca96470fe18098574d3d70e07ba3caf0b22750ee768c852b581572fea7e8\": container with ID starting with 7152ca96470fe18098574d3d70e07ba3caf0b22750ee768c852b581572fea7e8 not found: ID does not exist" containerID="7152ca96470fe18098574d3d70e07ba3caf0b22750ee768c852b581572fea7e8" Jul 23 23:09:55.362325 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:55.362261 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7152ca96470fe18098574d3d70e07ba3caf0b22750ee768c852b581572fea7e8"} err="failed to get container status \"7152ca96470fe18098574d3d70e07ba3caf0b22750ee768c852b581572fea7e8\": rpc error: code = NotFound desc = could not find container \"7152ca96470fe18098574d3d70e07ba3caf0b22750ee768c852b581572fea7e8\": container with ID starting with 7152ca96470fe18098574d3d70e07ba3caf0b22750ee768c852b581572fea7e8 not found: ID does not exist" Jul 23 23:09:55.362325 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:55.362276 2575 scope.go:117] "RemoveContainer" containerID="d028e93983c93c868d41cc339494b8a68cbed18b3dad74b12167810ca28cf776" Jul 23 23:09:55.362542 ip-10-0-134-206 kubenswrapper[2575]: E0723 23:09:55.362523 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d028e93983c93c868d41cc339494b8a68cbed18b3dad74b12167810ca28cf776\": container with ID starting with d028e93983c93c868d41cc339494b8a68cbed18b3dad74b12167810ca28cf776 not found: ID does not exist" containerID="d028e93983c93c868d41cc339494b8a68cbed18b3dad74b12167810ca28cf776" Jul 23 23:09:55.362589 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:55.362549 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d028e93983c93c868d41cc339494b8a68cbed18b3dad74b12167810ca28cf776"} err="failed to get container status \"d028e93983c93c868d41cc339494b8a68cbed18b3dad74b12167810ca28cf776\": rpc error: code = NotFound desc = could not find container \"d028e93983c93c868d41cc339494b8a68cbed18b3dad74b12167810ca28cf776\": container with ID starting with d028e93983c93c868d41cc339494b8a68cbed18b3dad74b12167810ca28cf776 not found: ID does not exist" Jul 23 23:09:55.366846 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:55.366824 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c"] Jul 23 23:09:55.370336 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:55.370315 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-8300e5-openshift-default-77d84c5db5-8vw6c"] Jul 23 23:09:55.423571 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:55.423550 2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a7f9028-e494-4ed3-a321-18747f8c5910-istio-envoy\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 23:09:55.423571 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:55.423569 2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a7f9028-e494-4ed3-a321-18747f8c5910-istio-podinfo\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 23:09:55.423694 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:55.423578 2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a7f9028-e494-4ed3-a321-18747f8c5910-istiod-ca-cert\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 23:09:55.423694 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:55.423587 2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a7f9028-e494-4ed3-a321-18747f8c5910-istio-data\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 23:09:55.423694 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:55.423595 2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a7f9028-e494-4ed3-a321-18747f8c5910-istio-token\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 23:09:55.423694 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:55.423603 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-czvm6\" (UniqueName: \"kubernetes.io/projected/6a7f9028-e494-4ed3-a321-18747f8c5910-kube-api-access-czvm6\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 23:09:56.808007 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:09:56.807973 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a7f9028-e494-4ed3-a321-18747f8c5910" path="/var/lib/kubelet/pods/6a7f9028-e494-4ed3-a321-18747f8c5910/volumes" Jul 23 23:10:09.324067 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:10:09.324036 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:10:09.355149 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:10:09.355115 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-4b3ef9-6474cd98d4-wt6bs"] Jul 23 23:10:09.355392 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:10:09.355362 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-4b3ef9-6474cd98d4-wt6bs" podUID="1d57dba4-e5dd-4175-8a0d-f8d5640802dd" containerName="payload-processing" containerID="cri-o://023638b109284f216b67e02c063b558b345b9b6b25fc4be854af00c818c4e005" gracePeriod=30 Jul 23 23:10:09.364675 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:10:09.364647 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-4b3ef9-6f56c9df6d-57fqn"] Jul 23 23:10:09.364891 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:10:09.364865 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-4b3ef9-6f56c9df6d-57fqn" podUID="4820ea4c-b792-4dd3-be25-acfb9a13a803" containerName="payload-pre-processing" containerID="cri-o://7bd146517352b40a1d5173676f36b84e1ef5b26bdd68bb73baacc951494de754" gracePeriod=30 Jul 23 23:10:09.614586 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:10:09.614564 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-4b3ef9-6474cd98d4-wt6bs" Jul 23 23:10:09.655086 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:10:09.655058 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-4b3ef9-6f56c9df6d-57fqn" Jul 23 23:10:09.744283 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:10:09.744257 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1d57dba4-e5dd-4175-8a0d-f8d5640802dd-plugins-config-volume\") pod \"1d57dba4-e5dd-4175-8a0d-f8d5640802dd\" (UID: \"1d57dba4-e5dd-4175-8a0d-f8d5640802dd\") " Jul 23 23:10:09.744406 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:10:09.744299 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4820ea4c-b792-4dd3-be25-acfb9a13a803-plugins-config-volume\") pod \"4820ea4c-b792-4dd3-be25-acfb9a13a803\" (UID: \"4820ea4c-b792-4dd3-be25-acfb9a13a803\") " Jul 23 23:10:09.744406 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:10:09.744333 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rsqgq\" (UniqueName: \"kubernetes.io/projected/1d57dba4-e5dd-4175-8a0d-f8d5640802dd-kube-api-access-rsqgq\") pod \"1d57dba4-e5dd-4175-8a0d-f8d5640802dd\" (UID: \"1d57dba4-e5dd-4175-8a0d-f8d5640802dd\") " Jul 23 23:10:09.744540 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:10:09.744452 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-drmg2\" (UniqueName: \"kubernetes.io/projected/4820ea4c-b792-4dd3-be25-acfb9a13a803-kube-api-access-drmg2\") pod \"4820ea4c-b792-4dd3-be25-acfb9a13a803\" (UID: \"4820ea4c-b792-4dd3-be25-acfb9a13a803\") " Jul 23 23:10:09.744783 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:10:09.744747 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4820ea4c-b792-4dd3-be25-acfb9a13a803-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4820ea4c-b792-4dd3-be25-acfb9a13a803" (UID: "4820ea4c-b792-4dd3-be25-acfb9a13a803"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 23:10:09.744892 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:10:09.744778 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d57dba4-e5dd-4175-8a0d-f8d5640802dd-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1d57dba4-e5dd-4175-8a0d-f8d5640802dd" (UID: "1d57dba4-e5dd-4175-8a0d-f8d5640802dd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 23:10:09.746445 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:10:09.746422 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d57dba4-e5dd-4175-8a0d-f8d5640802dd-kube-api-access-rsqgq" (OuterVolumeSpecName: "kube-api-access-rsqgq") pod "1d57dba4-e5dd-4175-8a0d-f8d5640802dd" (UID: "1d57dba4-e5dd-4175-8a0d-f8d5640802dd"). InnerVolumeSpecName "kube-api-access-rsqgq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 23:10:09.746560 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:10:09.746537 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4820ea4c-b792-4dd3-be25-acfb9a13a803-kube-api-access-drmg2" (OuterVolumeSpecName: "kube-api-access-drmg2") pod "4820ea4c-b792-4dd3-be25-acfb9a13a803" (UID: "4820ea4c-b792-4dd3-be25-acfb9a13a803"). InnerVolumeSpecName "kube-api-access-drmg2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 23:10:09.845817 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:10:09.845761 2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1d57dba4-e5dd-4175-8a0d-f8d5640802dd-plugins-config-volume\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 23:10:09.845817 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:10:09.845785 2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4820ea4c-b792-4dd3-be25-acfb9a13a803-plugins-config-volume\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 23:10:09.845817 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:10:09.845794 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rsqgq\" (UniqueName: \"kubernetes.io/projected/1d57dba4-e5dd-4175-8a0d-f8d5640802dd-kube-api-access-rsqgq\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 23:10:09.845817 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:10:09.845803 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-drmg2\" (UniqueName: \"kubernetes.io/projected/4820ea4c-b792-4dd3-be25-acfb9a13a803-kube-api-access-drmg2\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 23:10:10.284013 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:10:10.283973 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:10:10.441042 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:10:10.440989 2575 generic.go:356] "Generic (PLEG): container finished" podID="4820ea4c-b792-4dd3-be25-acfb9a13a803" containerID="7bd146517352b40a1d5173676f36b84e1ef5b26bdd68bb73baacc951494de754" exitCode=0 Jul 23 23:10:10.441422 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:10:10.441071 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-4b3ef9-6f56c9df6d-57fqn" Jul 23 23:10:10.441422 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:10:10.441100 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-4b3ef9-6f56c9df6d-57fqn" event={"ID":"4820ea4c-b792-4dd3-be25-acfb9a13a803","Type":"ContainerDied","Data":"7bd146517352b40a1d5173676f36b84e1ef5b26bdd68bb73baacc951494de754"} Jul 23 23:10:10.441422 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:10:10.441173 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-4b3ef9-6f56c9df6d-57fqn" event={"ID":"4820ea4c-b792-4dd3-be25-acfb9a13a803","Type":"ContainerDied","Data":"856c0047be824d07c19b522607eda3b60b10ba79af7f452607376f8bd4e0f421"} Jul 23 23:10:10.441422 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:10:10.441206 2575 scope.go:117] "RemoveContainer" containerID="7bd146517352b40a1d5173676f36b84e1ef5b26bdd68bb73baacc951494de754" Jul 23 23:10:10.443171 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:10:10.443148 2575 generic.go:356] "Generic (PLEG): container finished" podID="1d57dba4-e5dd-4175-8a0d-f8d5640802dd" containerID="023638b109284f216b67e02c063b558b345b9b6b25fc4be854af00c818c4e005" exitCode=0 Jul 23 23:10:10.443289 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:10:10.443220 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-4b3ef9-6474cd98d4-wt6bs" event={"ID":"1d57dba4-e5dd-4175-8a0d-f8d5640802dd","Type":"ContainerDied","Data":"023638b109284f216b67e02c063b558b345b9b6b25fc4be854af00c818c4e005"} Jul 23 23:10:10.443289 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:10:10.443260 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-4b3ef9-6474cd98d4-wt6bs" event={"ID":"1d57dba4-e5dd-4175-8a0d-f8d5640802dd","Type":"ContainerDied","Data":"419694db2c6c455f9b7ff1faa8ab9d8002fa7b4536f68f572e4be353155774fb"} Jul 23 23:10:10.443289 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:10:10.443264 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-4b3ef9-6474cd98d4-wt6bs" Jul 23 23:10:10.453108 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:10:10.453059 2575 scope.go:117] "RemoveContainer" containerID="7bd146517352b40a1d5173676f36b84e1ef5b26bdd68bb73baacc951494de754" Jul 23 23:10:10.453435 ip-10-0-134-206 kubenswrapper[2575]: E0723 23:10:10.453349 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7bd146517352b40a1d5173676f36b84e1ef5b26bdd68bb73baacc951494de754\": container with ID starting with 7bd146517352b40a1d5173676f36b84e1ef5b26bdd68bb73baacc951494de754 not found: ID does not exist" containerID="7bd146517352b40a1d5173676f36b84e1ef5b26bdd68bb73baacc951494de754" Jul 23 23:10:10.453435 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:10:10.453373 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7bd146517352b40a1d5173676f36b84e1ef5b26bdd68bb73baacc951494de754"} err="failed to get container status \"7bd146517352b40a1d5173676f36b84e1ef5b26bdd68bb73baacc951494de754\": rpc error: code = NotFound desc = could not find container \"7bd146517352b40a1d5173676f36b84e1ef5b26bdd68bb73baacc951494de754\": container with ID starting with 7bd146517352b40a1d5173676f36b84e1ef5b26bdd68bb73baacc951494de754 not found: ID does not exist" Jul 23 23:10:10.453435 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:10:10.453389 2575 scope.go:117] "RemoveContainer" containerID="023638b109284f216b67e02c063b558b345b9b6b25fc4be854af00c818c4e005" Jul 23 23:10:10.462058 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:10:10.462038 2575 scope.go:117] "RemoveContainer" containerID="023638b109284f216b67e02c063b558b345b9b6b25fc4be854af00c818c4e005" Jul 23 23:10:10.462320 ip-10-0-134-206 kubenswrapper[2575]: E0723 23:10:10.462296 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"023638b109284f216b67e02c063b558b345b9b6b25fc4be854af00c818c4e005\": container with ID starting with 023638b109284f216b67e02c063b558b345b9b6b25fc4be854af00c818c4e005 not found: ID does not exist" containerID="023638b109284f216b67e02c063b558b345b9b6b25fc4be854af00c818c4e005" Jul 23 23:10:10.462409 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:10:10.462323 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"023638b109284f216b67e02c063b558b345b9b6b25fc4be854af00c818c4e005"} err="failed to get container status \"023638b109284f216b67e02c063b558b345b9b6b25fc4be854af00c818c4e005\": rpc error: code = NotFound desc = could not find container \"023638b109284f216b67e02c063b558b345b9b6b25fc4be854af00c818c4e005\": container with ID starting with 023638b109284f216b67e02c063b558b345b9b6b25fc4be854af00c818c4e005 not found: ID does not exist" Jul 23 23:10:10.464456 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:10:10.464436 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-4b3ef9-6f56c9df6d-57fqn"] Jul 23 23:10:10.467849 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:10:10.467830 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-4b3ef9-6f56c9df6d-57fqn"] Jul 23 23:10:10.477216 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:10:10.477198 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-4b3ef9-6474cd98d4-wt6bs"] Jul 23 23:10:10.479340 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:10:10.479323 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-4b3ef9-6474cd98d4-wt6bs"] Jul 23 23:10:10.809078 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:10:10.809015 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d57dba4-e5dd-4175-8a0d-f8d5640802dd" path="/var/lib/kubelet/pods/1d57dba4-e5dd-4175-8a0d-f8d5640802dd/volumes" Jul 23 23:10:10.809497 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:10:10.809476 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4820ea4c-b792-4dd3-be25-acfb9a13a803" path="/var/lib/kubelet/pods/4820ea4c-b792-4dd3-be25-acfb9a13a803/volumes" Jul 23 23:10:13.889242 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:10:13.889213 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:10:14.288274 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:10:14.288248 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:10:19.310088 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:10:19.310052 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:10:56.452745 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:10:56.452710 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:10:56.602495 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:10:56.602465 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:11:02.494160 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:11:02.494130 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:11:08.219474 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:11:08.219437 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:11:08.320321 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:11:08.320260 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:11:08.505577 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:11:08.505484 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:11:08.753976 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:11:08.753923 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:11:19.391575 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:11:19.391542 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:11:19.456720 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:11:19.456681 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:11:19.513316 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:11:19.513274 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:11:23.953707 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:11:23.953660 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:11:24.338851 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:11:24.338780 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:11:30.271004 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:11:30.270971 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:11:30.327857 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:11:30.327830 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:11:30.524764 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:11:30.524687 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4"] Jul 23 23:11:30.524943 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:11:30.524918 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4" podUID="62b6e412-3610-4dd3-9d90-f254055650eb" containerName="istio-proxy" containerID="cri-o://0878393e614a4f65547efacff5ea294f78e993a7da8aefa9e755fb557fcf7538" gracePeriod=30 Jul 23 23:11:30.541574 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:11:30.541537 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:11:30.792131 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:11:30.792047 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:11:35.782241 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:11:35.782218 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4" Jul 23 23:11:35.925328 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:11:35.925298 2575 generic.go:356] "Generic (PLEG): container finished" podID="62b6e412-3610-4dd3-9d90-f254055650eb" containerID="0878393e614a4f65547efacff5ea294f78e993a7da8aefa9e755fb557fcf7538" exitCode=0 Jul 23 23:11:35.925478 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:11:35.925363 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4" Jul 23 23:11:35.925478 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:11:35.925369 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4" event={"ID":"62b6e412-3610-4dd3-9d90-f254055650eb","Type":"ContainerDied","Data":"0878393e614a4f65547efacff5ea294f78e993a7da8aefa9e755fb557fcf7538"} Jul 23 23:11:35.925478 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:11:35.925410 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4" event={"ID":"62b6e412-3610-4dd3-9d90-f254055650eb","Type":"ContainerDied","Data":"a1b7549cffe8468e6d3816fe9c7a891dc391fc3e247e6727f9355f2022e5d1e7"} Jul 23 23:11:35.925478 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:11:35.925432 2575 scope.go:117] "RemoveContainer" containerID="0878393e614a4f65547efacff5ea294f78e993a7da8aefa9e755fb557fcf7538" Jul 23 23:11:35.934224 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:11:35.934208 2575 scope.go:117] "RemoveContainer" containerID="ee7ebfae4ef084440dcf7f650df9821f1a801de864146a6ceec43a4a643d2231" Jul 23 23:11:35.942718 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:11:35.942688 2575 scope.go:117] "RemoveContainer" containerID="0878393e614a4f65547efacff5ea294f78e993a7da8aefa9e755fb557fcf7538" Jul 23 23:11:35.942968 ip-10-0-134-206 kubenswrapper[2575]: E0723 23:11:35.942950 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0878393e614a4f65547efacff5ea294f78e993a7da8aefa9e755fb557fcf7538\": container with ID starting with 0878393e614a4f65547efacff5ea294f78e993a7da8aefa9e755fb557fcf7538 not found: ID does not exist" containerID="0878393e614a4f65547efacff5ea294f78e993a7da8aefa9e755fb557fcf7538" Jul 23 23:11:35.943067 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:11:35.942980 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0878393e614a4f65547efacff5ea294f78e993a7da8aefa9e755fb557fcf7538"} err="failed to get container status \"0878393e614a4f65547efacff5ea294f78e993a7da8aefa9e755fb557fcf7538\": rpc error: code = NotFound desc = could not find container \"0878393e614a4f65547efacff5ea294f78e993a7da8aefa9e755fb557fcf7538\": container with ID starting with 0878393e614a4f65547efacff5ea294f78e993a7da8aefa9e755fb557fcf7538 not found: ID does not exist" Jul 23 23:11:35.943067 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:11:35.943004 2575 scope.go:117] "RemoveContainer" containerID="ee7ebfae4ef084440dcf7f650df9821f1a801de864146a6ceec43a4a643d2231" Jul 23 23:11:35.943258 ip-10-0-134-206 kubenswrapper[2575]: E0723 23:11:35.943241 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee7ebfae4ef084440dcf7f650df9821f1a801de864146a6ceec43a4a643d2231\": container with ID starting with ee7ebfae4ef084440dcf7f650df9821f1a801de864146a6ceec43a4a643d2231 not found: ID does not exist" containerID="ee7ebfae4ef084440dcf7f650df9821f1a801de864146a6ceec43a4a643d2231" Jul 23 23:11:35.943309 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:11:35.943265 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee7ebfae4ef084440dcf7f650df9821f1a801de864146a6ceec43a4a643d2231"} err="failed to get container status \"ee7ebfae4ef084440dcf7f650df9821f1a801de864146a6ceec43a4a643d2231\": rpc error: code = NotFound desc = could not find container \"ee7ebfae4ef084440dcf7f650df9821f1a801de864146a6ceec43a4a643d2231\": container with ID starting with ee7ebfae4ef084440dcf7f650df9821f1a801de864146a6ceec43a4a643d2231 not found: ID does not exist" Jul 23 23:11:35.948551 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:11:35.948533 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62b6e412-3610-4dd3-9d90-f254055650eb-istiod-ca-cert\") pod \"62b6e412-3610-4dd3-9d90-f254055650eb\" (UID: \"62b6e412-3610-4dd3-9d90-f254055650eb\") " Jul 23 23:11:35.948609 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:11:35.948584 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62b6e412-3610-4dd3-9d90-f254055650eb-istio-envoy\") pod \"62b6e412-3610-4dd3-9d90-f254055650eb\" (UID: \"62b6e412-3610-4dd3-9d90-f254055650eb\") " Jul 23 23:11:35.948660 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:11:35.948607 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62b6e412-3610-4dd3-9d90-f254055650eb-istio-data\") pod \"62b6e412-3610-4dd3-9d90-f254055650eb\" (UID: \"62b6e412-3610-4dd3-9d90-f254055650eb\") " Jul 23 23:11:35.948660 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:11:35.948635 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62b6e412-3610-4dd3-9d90-f254055650eb-workload-certs\") pod \"62b6e412-3610-4dd3-9d90-f254055650eb\" (UID: \"62b6e412-3610-4dd3-9d90-f254055650eb\") " Jul 23 23:11:35.948775 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:11:35.948665 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62b6e412-3610-4dd3-9d90-f254055650eb-istio-token\") pod \"62b6e412-3610-4dd3-9d90-f254055650eb\" (UID: \"62b6e412-3610-4dd3-9d90-f254055650eb\") " Jul 23 23:11:35.948775 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:11:35.948696 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62b6e412-3610-4dd3-9d90-f254055650eb-istio-podinfo\") pod \"62b6e412-3610-4dd3-9d90-f254055650eb\" (UID: \"62b6e412-3610-4dd3-9d90-f254055650eb\") " Jul 23 23:11:35.948775 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:11:35.948738 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62b6e412-3610-4dd3-9d90-f254055650eb-workload-socket\") pod \"62b6e412-3610-4dd3-9d90-f254055650eb\" (UID: \"62b6e412-3610-4dd3-9d90-f254055650eb\") " Jul 23 23:11:35.948930 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:11:35.948775 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bdq24\" (UniqueName: \"kubernetes.io/projected/62b6e412-3610-4dd3-9d90-f254055650eb-kube-api-access-bdq24\") pod \"62b6e412-3610-4dd3-9d90-f254055650eb\" (UID: \"62b6e412-3610-4dd3-9d90-f254055650eb\") " Jul 23 23:11:35.948930 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:11:35.948809 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62b6e412-3610-4dd3-9d90-f254055650eb-credential-socket\") pod \"62b6e412-3610-4dd3-9d90-f254055650eb\" (UID: \"62b6e412-3610-4dd3-9d90-f254055650eb\") " Jul 23 23:11:35.949048 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:11:35.948932 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62b6e412-3610-4dd3-9d90-f254055650eb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "62b6e412-3610-4dd3-9d90-f254055650eb" (UID: "62b6e412-3610-4dd3-9d90-f254055650eb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 23:11:35.949048 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:11:35.948958 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62b6e412-3610-4dd3-9d90-f254055650eb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "62b6e412-3610-4dd3-9d90-f254055650eb" (UID: "62b6e412-3610-4dd3-9d90-f254055650eb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 23:11:35.949158 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:11:35.949118 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62b6e412-3610-4dd3-9d90-f254055650eb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "62b6e412-3610-4dd3-9d90-f254055650eb" (UID: "62b6e412-3610-4dd3-9d90-f254055650eb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 23:11:35.949211 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:11:35.949162 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62b6e412-3610-4dd3-9d90-f254055650eb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "62b6e412-3610-4dd3-9d90-f254055650eb" (UID: "62b6e412-3610-4dd3-9d90-f254055650eb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 23:11:35.949211 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:11:35.949198 2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62b6e412-3610-4dd3-9d90-f254055650eb-istiod-ca-cert\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 23:11:35.949311 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:11:35.949219 2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62b6e412-3610-4dd3-9d90-f254055650eb-workload-certs\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 23:11:35.949311 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:11:35.949232 2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62b6e412-3610-4dd3-9d90-f254055650eb-workload-socket\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 23:11:35.949557 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:11:35.949526 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62b6e412-3610-4dd3-9d90-f254055650eb-istio-data" (OuterVolumeSpecName: "istio-data") pod "62b6e412-3610-4dd3-9d90-f254055650eb" (UID: "62b6e412-3610-4dd3-9d90-f254055650eb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 23:11:35.951173 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:11:35.951147 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62b6e412-3610-4dd3-9d90-f254055650eb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "62b6e412-3610-4dd3-9d90-f254055650eb" (UID: "62b6e412-3610-4dd3-9d90-f254055650eb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 23:11:35.951254 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:11:35.951213 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62b6e412-3610-4dd3-9d90-f254055650eb-istio-token" (OuterVolumeSpecName: "istio-token") pod "62b6e412-3610-4dd3-9d90-f254055650eb" (UID: "62b6e412-3610-4dd3-9d90-f254055650eb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 23:11:35.951254 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:11:35.951217 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62b6e412-3610-4dd3-9d90-f254055650eb-kube-api-access-bdq24" (OuterVolumeSpecName: "kube-api-access-bdq24") pod "62b6e412-3610-4dd3-9d90-f254055650eb" (UID: "62b6e412-3610-4dd3-9d90-f254055650eb"). InnerVolumeSpecName "kube-api-access-bdq24". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 23:11:35.951387 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:11:35.951369 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/62b6e412-3610-4dd3-9d90-f254055650eb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "62b6e412-3610-4dd3-9d90-f254055650eb" (UID: "62b6e412-3610-4dd3-9d90-f254055650eb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 23 23:11:36.050400 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:11:36.050379 2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62b6e412-3610-4dd3-9d90-f254055650eb-istio-envoy\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 23:11:36.050400 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:11:36.050399 2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62b6e412-3610-4dd3-9d90-f254055650eb-istio-data\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 23:11:36.050514 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:11:36.050408 2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62b6e412-3610-4dd3-9d90-f254055650eb-istio-token\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 23:11:36.050514 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:11:36.050415 2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62b6e412-3610-4dd3-9d90-f254055650eb-istio-podinfo\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 23:11:36.050514 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:11:36.050423 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bdq24\" (UniqueName: \"kubernetes.io/projected/62b6e412-3610-4dd3-9d90-f254055650eb-kube-api-access-bdq24\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 23:11:36.050514 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:11:36.050433 2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62b6e412-3610-4dd3-9d90-f254055650eb-credential-socket\") on node \"ip-10-0-134-206.ec2.internal\" DevicePath \"\"" Jul 23 23:11:36.247714 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:11:36.247676 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4"] Jul 23 23:11:36.251375 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:11:36.251350 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-4f67fa-openshift-default-558d58f99f-wf2p4"] Jul 23 23:11:36.814349 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:11:36.814315 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62b6e412-3610-4dd3-9d90-f254055650eb" path="/var/lib/kubelet/pods/62b6e412-3610-4dd3-9d90-f254055650eb/volumes" Jul 23 23:11:41.382973 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:11:41.382939 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:11:41.441125 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:11:41.441088 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:11:41.494909 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:11:41.494879 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:11:46.005980 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:11:46.005945 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:11:46.435883 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:11:46.435848 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:11:47.393402 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:11:47.393369 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:11:47.494198 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:11:47.494161 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:11:52.327567 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:11:52.327532 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:11:52.381679 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:11:52.381650 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:11:52.604539 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:11:52.604435 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:11:52.849283 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:11:52.849249 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:12:03.569092 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:03.569065 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:12:03.633767 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:03.633732 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:12:03.686470 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:03.686434 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:12:08.040541 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:08.040503 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:12:08.436744 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:08.436706 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:12:14.506917 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:14.506885 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:12:14.570562 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:14.570487 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:12:14.798851 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:14.798755 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:12:15.036288 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:15.036257 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:12:15.482265 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:15.482225 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-594fc54f5c-7qfnr_a6e2c76e-d71c-4952-b4a2-d562d803910a/authorino/0.log" Jul 23 23:12:21.140630 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:21.140595 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-82dhr_c5d218fa-2c98-4d18-acf7-634f4a14ca6c/manager/0.log" Jul 23 23:12:21.258234 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:21.258199 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-wdg95_c33f2b09-f61a-4d5e-a53e-6b1cfddb0ab7/manager/0.log" Jul 23 23:12:21.515301 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:21.515269 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-stgpz_dd788c3f-16af-4435-93cb-bd4102990b97/server/0.log" Jul 23 23:12:21.640071 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:21.640039 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-85w2g_771e5646-1a90-45c5-986f-e4fe256ea09b/manager/0.log" Jul 23 23:12:21.894889 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:21.894808 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-fc7cc8c86-r48dl_ad5ec099-8b13-4413-b074-00439e105408/manager/0.log" Jul 23 23:12:21.901436 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:21.901412 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-fc7cc8c86-r48dl_ad5ec099-8b13-4413-b074-00439e105408/copy-manifests/0.log" Jul 23 23:12:22.390018 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:22.389990 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-6c948d5d44-m6sr5_00d409e2-e5a6-45f1-9a54-7a6ab9a13c2b/maas-api/0.log" Jul 23 23:12:22.739768 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:22.739739 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-zwtc9_11aea479-2d6a-4ef0-aae2-1924c2ee694c/postgres/0.log" Jul 23 23:12:23.560011 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:23.559976 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j5xdn_39d4f5d9-1ac2-435d-8226-52432dec566a/util/0.log" Jul 23 23:12:23.565689 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:23.565669 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j5xdn_39d4f5d9-1ac2-435d-8226-52432dec566a/pull/0.log" Jul 23 23:12:23.571513 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:23.571496 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j5xdn_39d4f5d9-1ac2-435d-8226-52432dec566a/extract/0.log" Jul 23 23:12:23.693318 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:23.693289 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08z5gq_6f34302e-066b-4c26-905f-e36dc7a0be8c/util/0.log" Jul 23 23:12:23.699195 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:23.699170 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08z5gq_6f34302e-066b-4c26-905f-e36dc7a0be8c/pull/0.log" Jul 23 23:12:23.704787 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:23.704772 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08z5gq_6f34302e-066b-4c26-905f-e36dc7a0be8c/extract/0.log" Jul 23 23:12:23.823263 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:23.823187 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sgpl8_65fae1ae-9145-4942-be19-4e0736b5fbcf/util/0.log" Jul 23 23:12:23.828422 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:23.828402 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sgpl8_65fae1ae-9145-4942-be19-4e0736b5fbcf/pull/0.log" Jul 23 23:12:23.833678 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:23.833663 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sgpl8_65fae1ae-9145-4942-be19-4e0736b5fbcf/extract/0.log" Jul 23 23:12:23.952482 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:23.952450 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bbmw7_c7aed277-7f43-4f75-af77-33f463bac977/util/0.log" Jul 23 23:12:23.958495 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:23.958477 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bbmw7_c7aed277-7f43-4f75-af77-33f463bac977/pull/0.log" Jul 23 23:12:23.964294 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:23.964279 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bbmw7_c7aed277-7f43-4f75-af77-33f463bac977/extract/0.log" Jul 23 23:12:24.089341 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:24.089260 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-594fc54f5c-7qfnr_a6e2c76e-d71c-4952-b4a2-d562d803910a/authorino/0.log" Jul 23 23:12:24.219179 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:24.219145 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-629zk_9c995852-a2d1-48ee-874a-9e41fe5778fb/manager/0.log" Jul 23 23:12:24.339727 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:24.339644 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-fwmjl_44f0261d-a1b4-4630-8721-b48faa63cc98/manager/0.log" Jul 23 23:12:24.457595 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:24.457569 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-fgrbg_46695d21-ecd3-4a0d-8e74-c686ee386fe3/kuadrant-console-plugin/0.log" Jul 23 23:12:24.581525 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:24.581497 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-kfxxn_2ec47862-f260-4973-909c-0ff17c9a3d88/registry-server/0.log" Jul 23 23:12:24.710206 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:24.710163 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-bjnr6_fd13ddfa-7299-4ac5-818c-f497901eb449/manager/0.log" Jul 23 23:12:24.957820 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:24.957785 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-sbhns_82260dc9-836e-4586-a886-94d9e966213e/manager/0.log" Jul 23 23:12:25.693414 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:25.693354 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-699c848bdc-7pwp6_8742c97d-f8fe-4030-8480-6c862102b94a/kube-auth-proxy/0.log" Jul 23 23:12:25.948711 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:25.948634 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-sbdtt_225675f4-74e4-44dd-975b-d4c4267ba68a/payload-pre-processing/0.log" Jul 23 23:12:26.072820 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:26.072787 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-9wvrc_a5b6a8f7-a06a-4a1a-a4c8-19fe6713282c/payload-processing/0.log" Jul 23 23:12:26.560431 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:26.560399 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-2dwqb_6d4a2d23-155c-4589-a467-75da74093d0b/main/0.log" Jul 23 23:12:26.797809 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:26.797775 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-dvnb2_9989ccdb-51b5-4470-b8b7-4aed482811c7/main/0.log" Jul 23 23:12:27.043371 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:27.043341 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-wbwxj_f5040122-e952-47e4-9cb5-707d4b6ff52f/main/0.log" Jul 23 23:12:32.724744 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:32.724712 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:12:32.827226 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:32.827184 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:12:35.823377 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:35.823339 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-pl657_81890460-aa07-4749-aadd-909c876b9244/global-pull-secret-syncer/0.log" Jul 23 23:12:35.917086 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:35.917059 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" Jul 23 23:12:36.058587 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:36.058565 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-206.ec2.internal_c327b22ac949a2a8daf1ee2904cbe0b1/haproxy/0.log" Jul 23 23:12:40.576081 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:40.576046 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j5xdn_39d4f5d9-1ac2-435d-8226-52432dec566a/extract/0.log" Jul 23 23:12:40.596898 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:40.596875 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j5xdn_39d4f5d9-1ac2-435d-8226-52432dec566a/util/0.log" Jul 23 23:12:40.619868 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:40.619847 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j5xdn_39d4f5d9-1ac2-435d-8226-52432dec566a/pull/0.log" Jul 23 23:12:40.667292 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:40.667266 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08z5gq_6f34302e-066b-4c26-905f-e36dc7a0be8c/extract/0.log" Jul 23 23:12:40.696460 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:40.696436 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08z5gq_6f34302e-066b-4c26-905f-e36dc7a0be8c/util/0.log" Jul 23 23:12:40.718627 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:40.718605 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08z5gq_6f34302e-066b-4c26-905f-e36dc7a0be8c/pull/0.log" Jul 23 23:12:40.743834 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:40.743811 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sgpl8_65fae1ae-9145-4942-be19-4e0736b5fbcf/extract/0.log" Jul 23 23:12:40.763462 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:40.763433 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sgpl8_65fae1ae-9145-4942-be19-4e0736b5fbcf/util/0.log" Jul 23 23:12:40.783608 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:40.783586 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sgpl8_65fae1ae-9145-4942-be19-4e0736b5fbcf/pull/0.log" Jul 23 23:12:40.810235 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:40.810216 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bbmw7_c7aed277-7f43-4f75-af77-33f463bac977/extract/0.log" Jul 23 23:12:40.831344 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:40.831283 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bbmw7_c7aed277-7f43-4f75-af77-33f463bac977/util/0.log" Jul 23 23:12:40.856036 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:40.856004 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bbmw7_c7aed277-7f43-4f75-af77-33f463bac977/pull/0.log" Jul 23 23:12:41.184332 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:41.184301 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-594fc54f5c-7qfnr_a6e2c76e-d71c-4952-b4a2-d562d803910a/authorino/0.log" Jul 23 23:12:41.221819 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:41.221788 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-629zk_9c995852-a2d1-48ee-874a-9e41fe5778fb/manager/0.log" Jul 23 23:12:41.242803 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:41.242773 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-fwmjl_44f0261d-a1b4-4630-8721-b48faa63cc98/manager/0.log" Jul 23 23:12:41.271121 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:41.271099 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-fgrbg_46695d21-ecd3-4a0d-8e74-c686ee386fe3/kuadrant-console-plugin/0.log" Jul 23 23:12:41.321607 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:41.321577 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-kfxxn_2ec47862-f260-4973-909c-0ff17c9a3d88/registry-server/0.log" Jul 23 23:12:41.438740 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:41.438658 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-bjnr6_fd13ddfa-7299-4ac5-818c-f497901eb449/manager/0.log" Jul 23 23:12:41.554444 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:41.554411 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-sbhns_82260dc9-836e-4586-a886-94d9e966213e/manager/0.log" Jul 23 23:12:43.143115 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:43.143080 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b6f817a1-41e5-4ad9-ac58-adb648f2f644/alertmanager/0.log" Jul 23 23:12:43.163664 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:43.163641 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b6f817a1-41e5-4ad9-ac58-adb648f2f644/config-reloader/0.log" Jul 23 23:12:43.184467 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:43.184440 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b6f817a1-41e5-4ad9-ac58-adb648f2f644/kube-rbac-proxy-web/0.log" Jul 23 23:12:43.209869 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:43.209846 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b6f817a1-41e5-4ad9-ac58-adb648f2f644/kube-rbac-proxy/0.log" Jul 23 23:12:43.233151 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:43.233125 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b6f817a1-41e5-4ad9-ac58-adb648f2f644/kube-rbac-proxy-metric/0.log" Jul 23 23:12:43.253676 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:43.253647 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b6f817a1-41e5-4ad9-ac58-adb648f2f644/prom-label-proxy/0.log" Jul 23 23:12:43.280985 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:43.280950 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b6f817a1-41e5-4ad9-ac58-adb648f2f644/init-config-reloader/0.log" Jul 23 23:12:43.426171 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:43.426135 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-pq7w7_17c7b23f-94c8-40a6-ae98-04f7e7c0e7ed/kube-state-metrics/0.log" Jul 23 23:12:43.476236 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:43.476192 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-pq7w7_17c7b23f-94c8-40a6-ae98-04f7e7c0e7ed/kube-rbac-proxy-main/0.log" Jul 23 23:12:43.502200 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:43.502178 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-pq7w7_17c7b23f-94c8-40a6-ae98-04f7e7c0e7ed/kube-rbac-proxy-self/0.log" Jul 23 23:12:43.603801 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:43.603773 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4rsp4_0a96eb6f-ba5b-42ac-805c-6e36094d07bf/node-exporter/0.log" Jul 23 23:12:43.623329 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:43.623306 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4rsp4_0a96eb6f-ba5b-42ac-805c-6e36094d07bf/kube-rbac-proxy/0.log" Jul 23 23:12:43.644617 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:43.644594 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4rsp4_0a96eb6f-ba5b-42ac-805c-6e36094d07bf/init-textfile/0.log" Jul 23 23:12:43.830803 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:43.830773 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-vldwk_fa281f11-d5c2-49d8-b184-50b1695fa84b/kube-rbac-proxy-main/0.log" Jul 23 23:12:43.851780 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:43.851753 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-vldwk_fa281f11-d5c2-49d8-b184-50b1695fa84b/kube-rbac-proxy-self/0.log" Jul 23 23:12:43.871499 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:43.871472 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-vldwk_fa281f11-d5c2-49d8-b184-50b1695fa84b/openshift-state-metrics/0.log" Jul 23 23:12:44.120102 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:44.120012 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-85574b5f49-phx4w_850f951d-31d4-4880-9dc7-22cbed5f9237/prometheus-operator-admission-webhook/0.log" Jul 23 23:12:44.147930 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:44.147906 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7c5dff46bc-mxk6c_f19d86d6-2a2f-4948-beb2-0bae1288b635/telemeter-client/0.log" Jul 23 23:12:44.171015 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:44.170983 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7c5dff46bc-mxk6c_f19d86d6-2a2f-4948-beb2-0bae1288b635/reload/0.log" Jul 23 23:12:44.197047 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:44.197007 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7c5dff46bc-mxk6c_f19d86d6-2a2f-4948-beb2-0bae1288b635/kube-rbac-proxy/0.log" Jul 23 23:12:46.185306 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:46.185271 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-vbzbm/perf-node-gather-daemonset-f95fp"] Jul 23 23:12:46.185770 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:46.185749 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62b6e412-3610-4dd3-9d90-f254055650eb" containerName="istio-proxy" Jul 23 23:12:46.185770 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:46.185767 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="62b6e412-3610-4dd3-9d90-f254055650eb" containerName="istio-proxy" Jul 23 23:12:46.185890 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:46.185784 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a7f9028-e494-4ed3-a321-18747f8c5910" containerName="istio-proxy" Jul 23 23:12:46.185890 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:46.185793 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a7f9028-e494-4ed3-a321-18747f8c5910" containerName="istio-proxy" Jul 23 23:12:46.185890 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:46.185809 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4820ea4c-b792-4dd3-be25-acfb9a13a803" containerName="payload-pre-processing" Jul 23 23:12:46.185890 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:46.185817 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="4820ea4c-b792-4dd3-be25-acfb9a13a803" containerName="payload-pre-processing" Jul 23 23:12:46.185890 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:46.185826 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62b6e412-3610-4dd3-9d90-f254055650eb" containerName="istio-proxy" Jul 23 23:12:46.185890 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:46.185835 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="62b6e412-3610-4dd3-9d90-f254055650eb" containerName="istio-proxy" Jul 23 23:12:46.185890 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:46.185860 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a7f9028-e494-4ed3-a321-18747f8c5910" containerName="istio-proxy" Jul 23 23:12:46.185890 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:46.185868 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a7f9028-e494-4ed3-a321-18747f8c5910" containerName="istio-proxy" Jul 23 23:12:46.185890 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:46.185889 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d57dba4-e5dd-4175-8a0d-f8d5640802dd" containerName="payload-processing" Jul 23 23:12:46.186319 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:46.185899 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d57dba4-e5dd-4175-8a0d-f8d5640802dd" containerName="payload-processing" Jul 23 23:12:46.186319 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:46.186001 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="4820ea4c-b792-4dd3-be25-acfb9a13a803" containerName="payload-pre-processing" Jul 23 23:12:46.186319 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:46.186012 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a7f9028-e494-4ed3-a321-18747f8c5910" containerName="istio-proxy" Jul 23 23:12:46.186319 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:46.186036 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="62b6e412-3610-4dd3-9d90-f254055650eb" containerName="istio-proxy" Jul 23 23:12:46.186319 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:46.186049 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a7f9028-e494-4ed3-a321-18747f8c5910" containerName="istio-proxy" Jul 23 23:12:46.186319 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:46.186059 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d57dba4-e5dd-4175-8a0d-f8d5640802dd" containerName="payload-processing" Jul 23 23:12:46.188318 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:46.188299 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vbzbm/perf-node-gather-daemonset-f95fp" Jul 23 23:12:46.191001 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:46.190974 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vbzbm\"/\"kube-root-ca.crt\"" Jul 23 23:12:46.191356 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:46.191335 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-vbzbm\"/\"default-dockercfg-5tpj8\"" Jul 23 23:12:46.192853 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:46.191878 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vbzbm\"/\"openshift-service-ca.crt\"" Jul 23 23:12:46.200561 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:46.200533 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vbzbm/perf-node-gather-daemonset-f95fp"] Jul 23 23:12:46.265784 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:46.265751 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7ad09a78-4293-4402-a4b9-9db03c98d66f-sys\") pod \"perf-node-gather-daemonset-f95fp\" (UID: \"7ad09a78-4293-4402-a4b9-9db03c98d66f\") " pod="openshift-must-gather-vbzbm/perf-node-gather-daemonset-f95fp" Jul 23 23:12:46.265909 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:46.265820 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7ad09a78-4293-4402-a4b9-9db03c98d66f-podres\") pod \"perf-node-gather-daemonset-f95fp\" (UID: \"7ad09a78-4293-4402-a4b9-9db03c98d66f\") " pod="openshift-must-gather-vbzbm/perf-node-gather-daemonset-f95fp" Jul 23 23:12:46.265909 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:46.265852 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7ad09a78-4293-4402-a4b9-9db03c98d66f-lib-modules\") pod \"perf-node-gather-daemonset-f95fp\" (UID: \"7ad09a78-4293-4402-a4b9-9db03c98d66f\") " pod="openshift-must-gather-vbzbm/perf-node-gather-daemonset-f95fp" Jul 23 23:12:46.265909 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:46.265884 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcml9\" (UniqueName: \"kubernetes.io/projected/7ad09a78-4293-4402-a4b9-9db03c98d66f-kube-api-access-fcml9\") pod \"perf-node-gather-daemonset-f95fp\" (UID: \"7ad09a78-4293-4402-a4b9-9db03c98d66f\") " pod="openshift-must-gather-vbzbm/perf-node-gather-daemonset-f95fp" Jul 23 23:12:46.266052 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:46.265961 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7ad09a78-4293-4402-a4b9-9db03c98d66f-proc\") pod \"perf-node-gather-daemonset-f95fp\" (UID: \"7ad09a78-4293-4402-a4b9-9db03c98d66f\") " pod="openshift-must-gather-vbzbm/perf-node-gather-daemonset-f95fp" Jul 23 23:12:46.366426 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:46.366397 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7ad09a78-4293-4402-a4b9-9db03c98d66f-proc\") pod \"perf-node-gather-daemonset-f95fp\" (UID: \"7ad09a78-4293-4402-a4b9-9db03c98d66f\") " pod="openshift-must-gather-vbzbm/perf-node-gather-daemonset-f95fp" Jul 23 23:12:46.366509 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:46.366442 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7ad09a78-4293-4402-a4b9-9db03c98d66f-sys\") pod \"perf-node-gather-daemonset-f95fp\" (UID: \"7ad09a78-4293-4402-a4b9-9db03c98d66f\") " pod="openshift-must-gather-vbzbm/perf-node-gather-daemonset-f95fp" Jul 23 23:12:46.366509 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:46.366487 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7ad09a78-4293-4402-a4b9-9db03c98d66f-podres\") pod \"perf-node-gather-daemonset-f95fp\" (UID: \"7ad09a78-4293-4402-a4b9-9db03c98d66f\") " pod="openshift-must-gather-vbzbm/perf-node-gather-daemonset-f95fp" Jul 23 23:12:46.366595 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:46.366518 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7ad09a78-4293-4402-a4b9-9db03c98d66f-lib-modules\") pod \"perf-node-gather-daemonset-f95fp\" (UID: \"7ad09a78-4293-4402-a4b9-9db03c98d66f\") " pod="openshift-must-gather-vbzbm/perf-node-gather-daemonset-f95fp" Jul 23 23:12:46.366595 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:46.366525 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7ad09a78-4293-4402-a4b9-9db03c98d66f-proc\") pod \"perf-node-gather-daemonset-f95fp\" (UID: \"7ad09a78-4293-4402-a4b9-9db03c98d66f\") " pod="openshift-must-gather-vbzbm/perf-node-gather-daemonset-f95fp" Jul 23 23:12:46.366595 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:46.366546 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7ad09a78-4293-4402-a4b9-9db03c98d66f-sys\") pod \"perf-node-gather-daemonset-f95fp\" (UID: \"7ad09a78-4293-4402-a4b9-9db03c98d66f\") " pod="openshift-must-gather-vbzbm/perf-node-gather-daemonset-f95fp" Jul 23 23:12:46.366595 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:46.366548 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcml9\" (UniqueName: \"kubernetes.io/projected/7ad09a78-4293-4402-a4b9-9db03c98d66f-kube-api-access-fcml9\") pod \"perf-node-gather-daemonset-f95fp\" (UID: \"7ad09a78-4293-4402-a4b9-9db03c98d66f\") " pod="openshift-must-gather-vbzbm/perf-node-gather-daemonset-f95fp" Jul 23 23:12:46.366729 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:46.366642 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7ad09a78-4293-4402-a4b9-9db03c98d66f-podres\") pod \"perf-node-gather-daemonset-f95fp\" (UID: \"7ad09a78-4293-4402-a4b9-9db03c98d66f\") " pod="openshift-must-gather-vbzbm/perf-node-gather-daemonset-f95fp" Jul 23 23:12:46.366729 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:46.366684 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7ad09a78-4293-4402-a4b9-9db03c98d66f-lib-modules\") pod \"perf-node-gather-daemonset-f95fp\" (UID: \"7ad09a78-4293-4402-a4b9-9db03c98d66f\") " pod="openshift-must-gather-vbzbm/perf-node-gather-daemonset-f95fp" Jul 23 23:12:46.373859 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:46.373829 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcml9\" (UniqueName: \"kubernetes.io/projected/7ad09a78-4293-4402-a4b9-9db03c98d66f-kube-api-access-fcml9\") pod \"perf-node-gather-daemonset-f95fp\" (UID: \"7ad09a78-4293-4402-a4b9-9db03c98d66f\") " pod="openshift-must-gather-vbzbm/perf-node-gather-daemonset-f95fp" Jul 23 23:12:46.508540 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:46.508487 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vbzbm/perf-node-gather-daemonset-f95fp" Jul 23 23:12:46.639776 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:46.639750 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vbzbm/perf-node-gather-daemonset-f95fp"] Jul 23 23:12:46.641570 ip-10-0-134-206 kubenswrapper[2575]: W0723 23:12:46.641544 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7ad09a78_4293_4402_a4b9_9db03c98d66f.slice/crio-5cd327a91413b7d3d96e89ae09293360b6669d60f4a40fec7ab719b894896daa WatchSource:0}: Error finding container 5cd327a91413b7d3d96e89ae09293360b6669d60f4a40fec7ab719b894896daa: Status 404 returned error can't find the container with id 5cd327a91413b7d3d96e89ae09293360b6669d60f4a40fec7ab719b894896daa Jul 23 23:12:47.332087 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:47.332049 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vbzbm/perf-node-gather-daemonset-f95fp" event={"ID":"7ad09a78-4293-4402-a4b9-9db03c98d66f","Type":"ContainerStarted","Data":"9b3c80fdf512f3e4177bbce674074acb7f590265dc64ed12c817bda8f78de0aa"} Jul 23 23:12:47.332492 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:47.332108 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vbzbm/perf-node-gather-daemonset-f95fp" event={"ID":"7ad09a78-4293-4402-a4b9-9db03c98d66f","Type":"ContainerStarted","Data":"5cd327a91413b7d3d96e89ae09293360b6669d60f4a40fec7ab719b894896daa"} Jul 23 23:12:47.332492 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:47.332273 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-vbzbm/perf-node-gather-daemonset-f95fp" Jul 23 23:12:47.348601 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:47.348546 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-vbzbm/perf-node-gather-daemonset-f95fp" podStartSLOduration=1.348529231 podStartE2EDuration="1.348529231s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 23:12:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 23:12:47.347459666 +0000 UTC m=+2995.067456952" watchObservedRunningTime="2026-07-23 23:12:47.348529231 +0000 UTC m=+2995.068526491" Jul 23 23:12:48.644678 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:48.644648 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mqb8v_dbc57266-9fac-4ed8-b4b9-1adcfe33c3d6/dns/0.log" Jul 23 23:12:48.664236 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:48.664200 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mqb8v_dbc57266-9fac-4ed8-b4b9-1adcfe33c3d6/kube-rbac-proxy/0.log" Jul 23 23:12:48.751677 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:48.751642 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qwb6v_e3b1b5a6-36fa-44e7-9a9c-a2e045119f90/dns-node-resolver/0.log" Jul 23 23:12:49.288329 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:49.288284 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-56f57fb769-nnwh2_bd489273-20d6-4e66-98ae-9a3616fac8e1/registry/0.log" Jul 23 23:12:49.329809 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:49.329773 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9vqwp_29b80f76-486c-4fbb-a2ec-c66f223803ba/node-ca/0.log" Jul 23 23:12:50.493942 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:50.493916 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-699c848bdc-7pwp6_8742c97d-f8fe-4030-8480-6c862102b94a/kube-auth-proxy/0.log" Jul 23 23:12:50.617615 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:50.617583 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-sbdtt_225675f4-74e4-44dd-975b-d4c4267ba68a/payload-pre-processing/0.log" Jul 23 23:12:50.646140 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:50.646106 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-9wvrc_a5b6a8f7-a06a-4a1a-a4c8-19fe6713282c/payload-processing/0.log" Jul 23 23:12:51.516067 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:51.516039 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ldpfb_ce4e1208-e25f-4d28-bbce-5a10feadf578/serve-healthcheck-canary/0.log" Jul 23 23:12:52.061416 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:52.061378 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5mx76_2a15f276-17ef-41fe-b658-8adfb01e8077/kube-rbac-proxy/0.log" Jul 23 23:12:52.083094 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:52.083066 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5mx76_2a15f276-17ef-41fe-b658-8adfb01e8077/exporter/0.log" Jul 23 23:12:52.103492 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:52.103466 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5mx76_2a15f276-17ef-41fe-b658-8adfb01e8077/extractor/0.log" Jul 23 23:12:53.347629 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:53.347601 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-vbzbm/perf-node-gather-daemonset-f95fp" Jul 23 23:12:54.220388 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:54.220362 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-82dhr_c5d218fa-2c98-4d18-acf7-634f4a14ca6c/manager/0.log" Jul 23 23:12:54.408507 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:54.408473 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-wdg95_c33f2b09-f61a-4d5e-a53e-6b1cfddb0ab7/manager/0.log" Jul 23 23:12:54.556053 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:54.555956 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-stgpz_dd788c3f-16af-4435-93cb-bd4102990b97/server/0.log" Jul 23 23:12:54.624645 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:54.624616 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-85w2g_771e5646-1a90-45c5-986f-e4fe256ea09b/manager/0.log" Jul 23 23:12:54.765729 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:54.765699 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-fc7cc8c86-r48dl_ad5ec099-8b13-4413-b074-00439e105408/manager/0.log" Jul 23 23:12:54.785615 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:54.785593 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-fc7cc8c86-r48dl_ad5ec099-8b13-4413-b074-00439e105408/copy-manifests/0.log" Jul 23 23:12:57.087976 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:57.087946 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-699c848bdc-7pwp6_8742c97d-f8fe-4030-8480-6c862102b94a/kube-auth-proxy/0.log" Jul 23 23:12:57.185619 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:57.185590 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-sbdtt_225675f4-74e4-44dd-975b-d4c4267ba68a/payload-pre-processing/0.log" Jul 23 23:12:57.206291 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:57.206266 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-9wvrc_a5b6a8f7-a06a-4a1a-a4c8-19fe6713282c/payload-processing/0.log" Jul 23 23:12:57.590428 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:57.590394 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:12:57.640476 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:57.640448 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6t59s_74793765-85c1-4990-8cb0-892552debf77/konnectivity-agent/0.log" limit=1024 Jul 23 23:12:58.852389 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:58.852358 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-699c848bdc-7pwp6_8742c97d-f8fe-4030-8480-6c862102b94a/kube-auth-proxy/0.log" Jul 23 23:12:58.972400 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:58.972371 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-sbdtt_225675f4-74e4-44dd-975b-d4c4267ba68a/payload-pre-processing/0.log" Jul 23 23:12:58.992328 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:12:58.992306 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-9wvrc_a5b6a8f7-a06a-4a1a-a4c8-19fe6713282c/payload-processing/0.log" Jul 23 23:13:02.799357 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:13:02.799331 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2sdbj_0dbcc8cc-adc8-472c-976c-f30472ad20b2/kube-multus-additional-cni-plugins/0.log" Jul 23 23:13:02.827244 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:13:02.827216 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2sdbj_0dbcc8cc-adc8-472c-976c-f30472ad20b2/egress-router-binary-copy/0.log" Jul 23 23:13:02.847129 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:13:02.847108 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2sdbj_0dbcc8cc-adc8-472c-976c-f30472ad20b2/cni-plugins/0.log" Jul 23 23:13:02.866811 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:13:02.866783 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2sdbj_0dbcc8cc-adc8-472c-976c-f30472ad20b2/bond-cni-plugin/0.log" Jul 23 23:13:02.886627 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:13:02.886609 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2sdbj_0dbcc8cc-adc8-472c-976c-f30472ad20b2/routeoverride-cni/0.log" Jul 23 23:13:02.907170 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:13:02.907150 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2sdbj_0dbcc8cc-adc8-472c-976c-f30472ad20b2/whereabouts-cni-bincopy/0.log" Jul 23 23:13:02.926783 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:13:02.926762 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2sdbj_0dbcc8cc-adc8-472c-976c-f30472ad20b2/whereabouts-cni/0.log" Jul 23 23:13:03.260080 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:13:03.260054 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-q66nz_13d4e65e-9e85-4531-a139-0224fac37ac3/kube-multus/0.log" Jul 23 23:13:03.321301 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:13:03.321266 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fd6hg_fc3410ae-ba34-41dc-b992-c51a7bd26fd4/network-metrics-daemon/0.log" Jul 23 23:13:03.338982 ip-10-0-134-206 kubenswrapper[2575]: I0723 23:13:03.338958 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fd6hg_fc3410ae-ba34-41dc-b992-c51a7bd26fd4/kube-rbac-proxy/0.log"