Jul 30 12:59:10.653306 ip-10-0-133-230 systemd[1]: Starting Kubernetes Kubelet... Jul 30 12:59:11.054700 ip-10-0-133-230 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 30 12:59:11.054700 ip-10-0-133-230 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 30 12:59:11.054700 ip-10-0-133-230 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 30 12:59:11.054700 ip-10-0-133-230 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 30 12:59:11.054700 ip-10-0-133-230 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 30 12:59:11.056830 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.056742 2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 30 12:59:11.064425 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064399 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 30 12:59:11.064425 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064422 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 30 12:59:11.064425 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064426 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 30 12:59:11.064425 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064429 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 30 12:59:11.064425 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064432 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 30 12:59:11.064630 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064437 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 30 12:59:11.064630 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064442 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 30 12:59:11.064630 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064446 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 30 12:59:11.064630 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064449 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 30 12:59:11.064630 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064451 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 30 12:59:11.064630 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064454 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 30 12:59:11.064630 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064457 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 30 12:59:11.064630 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064460 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 30 12:59:11.064630 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064463 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 30 12:59:11.064630 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064466 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 30 12:59:11.064630 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064468 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 30 12:59:11.064630 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064471 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 30 12:59:11.064630 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064474 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 30 12:59:11.064630 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064477 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 30 12:59:11.064630 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064479 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 30 12:59:11.064630 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064482 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 30 12:59:11.064630 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064484 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 30 12:59:11.064630 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064487 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 30 12:59:11.064630 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064489 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 30 12:59:11.064630 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064491 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 30 12:59:11.065163 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064494 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 30 12:59:11.065163 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064496 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 30 12:59:11.065163 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064500 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 30 12:59:11.065163 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064505 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 30 12:59:11.065163 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064508 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 30 12:59:11.065163 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064512 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 30 12:59:11.065163 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064515 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 30 12:59:11.065163 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064518 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 30 12:59:11.065163 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064521 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 30 12:59:11.065163 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064524 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 30 12:59:11.065163 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064526 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 30 12:59:11.065163 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064529 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 30 12:59:11.065163 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064531 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 30 12:59:11.065163 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064534 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 30 12:59:11.065163 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064537 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 30 12:59:11.065163 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064541 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 30 12:59:11.065163 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064543 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 30 12:59:11.065163 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064546 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 30 12:59:11.065163 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064549 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 30 12:59:11.065641 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064552 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 30 12:59:11.065641 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064554 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 30 12:59:11.065641 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064557 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 30 12:59:11.065641 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064559 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 30 12:59:11.065641 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064562 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 30 12:59:11.065641 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064564 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 30 12:59:11.065641 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064573 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 30 12:59:11.065641 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064576 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 30 12:59:11.065641 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064578 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 30 12:59:11.065641 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064581 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 30 12:59:11.065641 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064583 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 30 12:59:11.065641 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064586 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 30 12:59:11.065641 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064588 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 30 12:59:11.065641 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064590 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 30 12:59:11.065641 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064593 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 30 12:59:11.065641 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064597 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 30 12:59:11.065641 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064599 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 30 12:59:11.065641 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064602 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 30 12:59:11.065641 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064604 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 30 12:59:11.065641 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064606 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 30 12:59:11.066137 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064609 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 30 12:59:11.066137 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064612 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 30 12:59:11.066137 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064614 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 30 12:59:11.066137 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064617 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 30 12:59:11.066137 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064619 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 30 12:59:11.066137 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064622 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 30 12:59:11.066137 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064626 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 30 12:59:11.066137 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064628 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 30 12:59:11.066137 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064631 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 30 12:59:11.066137 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064634 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 30 12:59:11.066137 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064637 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 30 12:59:11.066137 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064639 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 30 12:59:11.066137 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064642 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 30 12:59:11.066137 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064645 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 30 12:59:11.066137 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064647 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 30 12:59:11.066137 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064649 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 30 12:59:11.066137 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064652 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 30 12:59:11.066137 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064655 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 30 12:59:11.066137 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064657 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 30 12:59:11.066137 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064661 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 30 12:59:11.066137 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064663 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 30 12:59:11.066656 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064666 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 30 12:59:11.066656 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064668 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 30 12:59:11.066656 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064671 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 30 12:59:11.066656 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064673 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 30 12:59:11.066656 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064676 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 30 12:59:11.066656 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064679 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 30 12:59:11.066656 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064681 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 30 12:59:11.066656 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064684 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 30 12:59:11.066656 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064686 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 30 12:59:11.066656 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064689 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 30 12:59:11.066656 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064692 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 30 12:59:11.066656 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064695 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 30 12:59:11.066656 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064699 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 30 12:59:11.066656 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.064703 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 30 12:59:11.066656 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065468 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 30 12:59:11.066656 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065476 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 30 12:59:11.066656 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065479 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 30 12:59:11.066656 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065484 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 30 12:59:11.066656 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065488 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 30 12:59:11.067139 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065491 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 30 12:59:11.067139 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065494 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 30 12:59:11.067139 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065497 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 30 12:59:11.067139 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065500 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 30 12:59:11.067139 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065502 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 30 12:59:11.067139 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065505 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 30 12:59:11.067139 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065508 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 30 12:59:11.067139 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065510 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 30 12:59:11.067139 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065513 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 30 12:59:11.067139 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065516 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 30 12:59:11.067139 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065518 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 30 12:59:11.067139 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065522 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 30 12:59:11.067139 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065525 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 30 12:59:11.067139 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065528 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 30 12:59:11.067139 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065531 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 30 12:59:11.067139 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065534 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 30 12:59:11.067139 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065537 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 30 12:59:11.067139 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065539 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 30 12:59:11.067139 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065542 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 30 12:59:11.067139 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065544 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 30 12:59:11.067645 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065547 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 30 12:59:11.067645 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065550 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 30 12:59:11.067645 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065552 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 30 12:59:11.067645 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065555 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 30 12:59:11.067645 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065557 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 30 12:59:11.067645 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065560 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 30 12:59:11.067645 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065563 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 30 12:59:11.067645 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065567 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 30 12:59:11.067645 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065569 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 30 12:59:11.067645 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065572 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 30 12:59:11.067645 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065575 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 30 12:59:11.067645 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065577 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 30 12:59:11.067645 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065580 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 30 12:59:11.067645 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065583 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 30 12:59:11.067645 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065586 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 30 12:59:11.067645 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065589 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 30 12:59:11.067645 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065591 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 30 12:59:11.067645 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065594 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 30 12:59:11.067645 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065596 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 30 12:59:11.068126 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065599 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 30 12:59:11.068126 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065601 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 30 12:59:11.068126 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065604 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 30 12:59:11.068126 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065606 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 30 12:59:11.068126 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065609 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 30 12:59:11.068126 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065612 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 30 12:59:11.068126 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065615 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 30 12:59:11.068126 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065618 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 30 12:59:11.068126 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065621 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 30 12:59:11.068126 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065623 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 30 12:59:11.068126 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065626 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 30 12:59:11.068126 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065628 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 30 12:59:11.068126 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065631 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 30 12:59:11.068126 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065634 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 30 12:59:11.068126 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065636 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 30 12:59:11.068126 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065639 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 30 12:59:11.068126 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065642 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 30 12:59:11.068126 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065644 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 30 12:59:11.068126 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065647 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 30 12:59:11.068126 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065650 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 30 12:59:11.068646 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065654 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 30 12:59:11.068646 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065657 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 30 12:59:11.068646 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065660 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 30 12:59:11.068646 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065663 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 30 12:59:11.068646 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065665 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 30 12:59:11.068646 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065668 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 30 12:59:11.068646 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065670 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 30 12:59:11.068646 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065673 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 30 12:59:11.068646 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065675 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 30 12:59:11.068646 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065678 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 30 12:59:11.068646 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065680 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 30 12:59:11.068646 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065683 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 30 12:59:11.068646 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065685 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 30 12:59:11.068646 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065687 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 30 12:59:11.068646 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065690 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 30 12:59:11.068646 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065693 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 30 12:59:11.068646 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065697 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 30 12:59:11.068646 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065699 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 30 12:59:11.068646 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065701 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 30 12:59:11.068646 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065704 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 30 12:59:11.069148 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065707 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 30 12:59:11.069148 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065709 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 30 12:59:11.069148 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065711 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 30 12:59:11.069148 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065714 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 30 12:59:11.069148 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065716 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 30 12:59:11.069148 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065719 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 30 12:59:11.069148 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065721 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 30 12:59:11.069148 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065724 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 30 12:59:11.069148 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065727 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 30 12:59:11.069148 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065731 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 30 12:59:11.069148 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065733 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 30 12:59:11.069148 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065736 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 30 12:59:11.069148 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065739 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 30 12:59:11.069148 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065742 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 30 12:59:11.069148 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.065745 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 30 12:59:11.069148 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066218 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 30 12:59:11.069148 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066224 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 30 12:59:11.069148 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066227 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 30 12:59:11.069148 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066230 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 30 12:59:11.069620 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066233 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 30 12:59:11.069620 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066235 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 30 12:59:11.069620 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066238 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 30 12:59:11.069620 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066240 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 30 12:59:11.069620 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066243 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 30 12:59:11.069620 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066246 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 30 12:59:11.069620 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066248 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 30 12:59:11.069620 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066251 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 30 12:59:11.069620 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066253 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 30 12:59:11.069620 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066256 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 30 12:59:11.069620 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066259 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 30 12:59:11.069620 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066261 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 30 12:59:11.069620 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066264 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 30 12:59:11.069620 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066267 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 30 12:59:11.069620 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066269 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 30 12:59:11.069620 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066272 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 30 12:59:11.069620 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066275 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 30 12:59:11.069620 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066278 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 30 12:59:11.069620 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066281 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 30 12:59:11.069620 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066283 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 30 12:59:11.070163 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066286 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 30 12:59:11.070163 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066288 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 30 12:59:11.070163 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066292 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 30 12:59:11.070163 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066296 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 30 12:59:11.070163 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066299 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 30 12:59:11.070163 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066301 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 30 12:59:11.070163 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066304 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 30 12:59:11.070163 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066307 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 30 12:59:11.070163 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066309 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 30 12:59:11.070163 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066312 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 30 12:59:11.070163 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066314 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 30 12:59:11.070163 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066317 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 30 12:59:11.070163 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066319 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 30 12:59:11.070163 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066322 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 30 12:59:11.070163 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066324 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 30 12:59:11.070163 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066327 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 30 12:59:11.070163 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066329 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 30 12:59:11.070163 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066331 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 30 12:59:11.070163 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066334 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 30 12:59:11.070628 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066336 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 30 12:59:11.070628 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066340 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 30 12:59:11.070628 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066344 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 30 12:59:11.070628 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066347 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 30 12:59:11.070628 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066349 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 30 12:59:11.070628 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066352 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 30 12:59:11.070628 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066355 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 30 12:59:11.070628 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066358 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 30 12:59:11.070628 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066361 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 30 12:59:11.070628 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066364 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 30 12:59:11.070628 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066366 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 30 12:59:11.070628 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066369 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 30 12:59:11.070628 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066371 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 30 12:59:11.070628 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066374 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 30 12:59:11.070628 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066377 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 30 12:59:11.070628 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066379 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 30 12:59:11.070628 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066381 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 30 12:59:11.070628 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066384 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 30 12:59:11.070628 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066387 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 30 12:59:11.070628 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066389 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 30 12:59:11.071128 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066392 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 30 12:59:11.071128 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066394 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 30 12:59:11.071128 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066396 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 30 12:59:11.071128 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066399 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 30 12:59:11.071128 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066401 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 30 12:59:11.071128 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066404 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 30 12:59:11.071128 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066406 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 30 12:59:11.071128 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066409 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 30 12:59:11.071128 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066411 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 30 12:59:11.071128 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066414 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 30 12:59:11.071128 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066416 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 30 12:59:11.071128 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066419 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 30 12:59:11.071128 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066421 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 30 12:59:11.071128 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066424 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 30 12:59:11.071128 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066427 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 30 12:59:11.071128 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066435 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 30 12:59:11.071128 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066438 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 30 12:59:11.071128 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066440 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 30 12:59:11.071128 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066443 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 30 12:59:11.071128 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066446 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 30 12:59:11.071652 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066448 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 30 12:59:11.071652 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066451 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 30 12:59:11.071652 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066454 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 30 12:59:11.071652 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066456 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 30 12:59:11.071652 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066459 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 30 12:59:11.071652 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066462 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 30 12:59:11.071652 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066464 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 30 12:59:11.071652 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066467 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 30 12:59:11.071652 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066471 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 30 12:59:11.071652 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066473 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 30 12:59:11.071652 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066476 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 30 12:59:11.071652 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066479 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 30 12:59:11.071652 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066483 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 30 12:59:11.071652 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066485 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 30 12:59:11.071652 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066488 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 30 12:59:11.071652 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.066491 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 30 12:59:11.071652 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066561 2579 flags.go:64] FLAG: --address="0.0.0.0" Jul 30 12:59:11.071652 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066568 2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 30 12:59:11.071652 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066575 2579 flags.go:64] FLAG: --anonymous-auth="true" Jul 30 12:59:11.071652 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066580 2579 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 30 12:59:11.072156 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066585 2579 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 30 12:59:11.072156 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066588 2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 30 12:59:11.072156 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066592 2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 30 12:59:11.072156 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066600 2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 30 12:59:11.072156 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066604 2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 30 12:59:11.072156 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066607 2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 30 12:59:11.072156 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066613 2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 30 12:59:11.072156 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066616 2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 30 12:59:11.072156 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066619 2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 30 12:59:11.072156 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066623 2579 flags.go:64] FLAG: --cgroup-root="" Jul 30 12:59:11.072156 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066625 2579 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 30 12:59:11.072156 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066628 2579 flags.go:64] FLAG: --client-ca-file="" Jul 30 12:59:11.072156 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066632 2579 flags.go:64] FLAG: --cloud-provider="external" Jul 30 12:59:11.072156 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066635 2579 flags.go:64] FLAG: --cluster-dns="[]" Jul 30 12:59:11.072156 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066640 2579 flags.go:64] FLAG: --cluster-domain="" Jul 30 12:59:11.072156 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066643 2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 30 12:59:11.072156 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066646 2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 30 12:59:11.072156 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066649 2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 30 12:59:11.072156 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066652 2579 flags.go:64] FLAG: --container-log-max-files="5" Jul 30 12:59:11.072156 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066656 2579 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 30 12:59:11.072156 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066659 2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 30 12:59:11.072156 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066662 2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 30 12:59:11.072156 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066666 2579 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 30 12:59:11.072796 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066669 2579 flags.go:64] FLAG: --contention-profiling="false" Jul 30 12:59:11.072796 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066672 2579 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 30 12:59:11.072796 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066675 2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 30 12:59:11.072796 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066678 2579 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 30 12:59:11.072796 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066681 2579 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 30 12:59:11.072796 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066685 2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 30 12:59:11.072796 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066688 2579 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 30 12:59:11.072796 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066692 2579 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 30 12:59:11.072796 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066695 2579 flags.go:64] FLAG: --enable-load-reader="false" Jul 30 12:59:11.072796 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066697 2579 flags.go:64] FLAG: --enable-server="true" Jul 30 12:59:11.072796 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066700 2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 30 12:59:11.072796 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066705 2579 flags.go:64] FLAG: --event-burst="100" Jul 30 12:59:11.072796 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066709 2579 flags.go:64] FLAG: --event-qps="50" Jul 30 12:59:11.072796 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066712 2579 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 30 12:59:11.072796 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066715 2579 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 30 12:59:11.072796 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066719 2579 flags.go:64] FLAG: --eviction-hard="" Jul 30 12:59:11.072796 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066723 2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 30 12:59:11.072796 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066726 2579 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 30 12:59:11.072796 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066729 2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 30 12:59:11.072796 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066732 2579 flags.go:64] FLAG: --eviction-soft="" Jul 30 12:59:11.072796 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066735 2579 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 30 12:59:11.072796 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066738 2579 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 30 12:59:11.072796 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066744 2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 30 12:59:11.072796 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066747 2579 flags.go:64] FLAG: --experimental-mounter-path="" Jul 30 12:59:11.072796 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066750 2579 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 30 12:59:11.073438 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066753 2579 flags.go:64] FLAG: --fail-swap-on="true" Jul 30 12:59:11.073438 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066756 2579 flags.go:64] FLAG: --feature-gates="" Jul 30 12:59:11.073438 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066759 2579 flags.go:64] FLAG: --file-check-frequency="20s" Jul 30 12:59:11.073438 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066762 2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 30 12:59:11.073438 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066765 2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 30 12:59:11.073438 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066768 2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 30 12:59:11.073438 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066772 2579 flags.go:64] FLAG: --healthz-port="10248" Jul 30 12:59:11.073438 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066775 2579 flags.go:64] FLAG: --help="false" Jul 30 12:59:11.073438 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066778 2579 flags.go:64] FLAG: --hostname-override="ip-10-0-133-230.ec2.internal" Jul 30 12:59:11.073438 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066781 2579 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 30 12:59:11.073438 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066784 2579 flags.go:64] FLAG: --http-check-frequency="20s" Jul 30 12:59:11.073438 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066787 2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 30 12:59:11.073438 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066790 2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 30 12:59:11.073438 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066793 2579 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 30 12:59:11.073438 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066796 2579 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 30 12:59:11.073438 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066799 2579 flags.go:64] FLAG: --image-service-endpoint="" Jul 30 12:59:11.073438 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066802 2579 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 30 12:59:11.073438 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066805 2579 flags.go:64] FLAG: --kube-api-burst="100" Jul 30 12:59:11.073438 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066807 2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 30 12:59:11.073438 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066811 2579 flags.go:64] FLAG: --kube-api-qps="50" Jul 30 12:59:11.073438 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066814 2579 flags.go:64] FLAG: --kube-reserved="" Jul 30 12:59:11.073438 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066817 2579 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 30 12:59:11.073438 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066821 2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 30 12:59:11.073438 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066824 2579 flags.go:64] FLAG: --kubelet-cgroups="" Jul 30 12:59:11.074061 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066827 2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 30 12:59:11.074061 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066830 2579 flags.go:64] FLAG: --lock-file="" Jul 30 12:59:11.074061 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066832 2579 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 30 12:59:11.074061 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066835 2579 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 30 12:59:11.074061 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066838 2579 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 30 12:59:11.074061 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066844 2579 flags.go:64] FLAG: --log-json-split-stream="false" Jul 30 12:59:11.074061 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066847 2579 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 30 12:59:11.074061 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066850 2579 flags.go:64] FLAG: --log-text-split-stream="false" Jul 30 12:59:11.074061 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066853 2579 flags.go:64] FLAG: --logging-format="text" Jul 30 12:59:11.074061 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066856 2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 30 12:59:11.074061 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066859 2579 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 30 12:59:11.074061 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066862 2579 flags.go:64] FLAG: --manifest-url="" Jul 30 12:59:11.074061 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066865 2579 flags.go:64] FLAG: --manifest-url-header="" Jul 30 12:59:11.074061 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066869 2579 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 30 12:59:11.074061 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066872 2579 flags.go:64] FLAG: --max-open-files="1000000" Jul 30 12:59:11.074061 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066876 2579 flags.go:64] FLAG: --max-pods="110" Jul 30 12:59:11.074061 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066879 2579 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 30 12:59:11.074061 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066882 2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 30 12:59:11.074061 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066885 2579 flags.go:64] FLAG: --memory-manager-policy="None" Jul 30 12:59:11.074061 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066888 2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 30 12:59:11.074061 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066891 2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 30 12:59:11.074061 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066894 2579 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 30 12:59:11.074061 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066897 2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 30 12:59:11.074061 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066904 2579 flags.go:64] FLAG: --node-status-max-images="50" Jul 30 12:59:11.074061 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066907 2579 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 30 12:59:11.074707 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066910 2579 flags.go:64] FLAG: --oom-score-adj="-999" Jul 30 12:59:11.074707 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066913 2579 flags.go:64] FLAG: --pod-cidr="" Jul 30 12:59:11.074707 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066917 2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 30 12:59:11.074707 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066922 2579 flags.go:64] FLAG: --pod-manifest-path="" Jul 30 12:59:11.074707 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066925 2579 flags.go:64] FLAG: --pod-max-pids="-1" Jul 30 12:59:11.074707 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066928 2579 flags.go:64] FLAG: --pods-per-core="0" Jul 30 12:59:11.074707 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066932 2579 flags.go:64] FLAG: --port="10250" Jul 30 12:59:11.074707 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066949 2579 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 30 12:59:11.074707 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066954 2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0437aac081303b130" Jul 30 12:59:11.074707 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066959 2579 flags.go:64] FLAG: --qos-reserved="" Jul 30 12:59:11.074707 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066962 2579 flags.go:64] FLAG: --read-only-port="10255" Jul 30 12:59:11.074707 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066966 2579 flags.go:64] FLAG: --register-node="true" Jul 30 12:59:11.074707 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066968 2579 flags.go:64] FLAG: --register-with-taints="" Jul 30 12:59:11.074707 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066972 2579 flags.go:64] FLAG: --registry-burst="10" Jul 30 12:59:11.074707 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066976 2579 flags.go:64] FLAG: --registry-qps="5" Jul 30 12:59:11.074707 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066980 2579 flags.go:64] FLAG: --reserved-cpus="" Jul 30 12:59:11.074707 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066983 2579 flags.go:64] FLAG: --reserved-memory="" Jul 30 12:59:11.074707 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066986 2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 30 12:59:11.074707 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066989 2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 30 12:59:11.074707 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066992 2579 flags.go:64] FLAG: --rotate-certificates="false" Jul 30 12:59:11.074707 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066995 2579 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 30 12:59:11.074707 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.066998 2579 flags.go:64] FLAG: --runonce="false" Jul 30 12:59:11.074707 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.067001 2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 30 12:59:11.074707 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.067004 2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 30 12:59:11.074707 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.067007 2579 flags.go:64] FLAG: --seccomp-default="false" Jul 30 12:59:11.075468 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.067010 2579 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 30 12:59:11.075468 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.067013 2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 30 12:59:11.075468 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.067016 2579 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 30 12:59:11.075468 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.067019 2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 30 12:59:11.075468 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.067022 2579 flags.go:64] FLAG: --storage-driver-password="root" Jul 30 12:59:11.075468 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.067024 2579 flags.go:64] FLAG: --storage-driver-secure="false" Jul 30 12:59:11.075468 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.067028 2579 flags.go:64] FLAG: --storage-driver-table="stats" Jul 30 12:59:11.075468 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.067031 2579 flags.go:64] FLAG: --storage-driver-user="root" Jul 30 12:59:11.075468 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.067034 2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 30 12:59:11.075468 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.067038 2579 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 30 12:59:11.075468 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.067041 2579 flags.go:64] FLAG: --system-cgroups="" Jul 30 12:59:11.075468 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.067044 2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 30 12:59:11.075468 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.067050 2579 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 30 12:59:11.075468 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.067054 2579 flags.go:64] FLAG: --tls-cert-file="" Jul 30 12:59:11.075468 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.067057 2579 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 30 12:59:11.075468 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.067061 2579 flags.go:64] FLAG: --tls-min-version="" Jul 30 12:59:11.075468 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.067063 2579 flags.go:64] FLAG: --tls-private-key-file="" Jul 30 12:59:11.075468 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.067066 2579 flags.go:64] FLAG: --topology-manager-policy="none" Jul 30 12:59:11.075468 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.067069 2579 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 30 12:59:11.075468 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.067072 2579 flags.go:64] FLAG: --topology-manager-scope="container" Jul 30 12:59:11.075468 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.067075 2579 flags.go:64] FLAG: --v="2" Jul 30 12:59:11.075468 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.067079 2579 flags.go:64] FLAG: --version="false" Jul 30 12:59:11.075468 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.067084 2579 flags.go:64] FLAG: --vmodule="" Jul 30 12:59:11.075468 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.067088 2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 30 12:59:11.075468 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.067091 2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 30 12:59:11.076100 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067232 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 30 12:59:11.076100 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067236 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 30 12:59:11.076100 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067239 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 30 12:59:11.076100 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067243 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 30 12:59:11.076100 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067246 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 30 12:59:11.076100 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067248 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 30 12:59:11.076100 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067251 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 30 12:59:11.076100 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067254 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 30 12:59:11.076100 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067257 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 30 12:59:11.076100 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067259 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 30 12:59:11.076100 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067263 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 30 12:59:11.076100 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067266 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 30 12:59:11.076100 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067269 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 30 12:59:11.076100 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067271 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 30 12:59:11.076100 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067274 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 30 12:59:11.076100 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067277 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 30 12:59:11.076100 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067281 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 30 12:59:11.076100 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067283 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 30 12:59:11.076100 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067286 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 30 12:59:11.076554 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067288 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 30 12:59:11.076554 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067295 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 30 12:59:11.076554 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067297 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 30 12:59:11.076554 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067300 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 30 12:59:11.076554 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067302 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 30 12:59:11.076554 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067305 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 30 12:59:11.076554 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067308 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 30 12:59:11.076554 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067310 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 30 12:59:11.076554 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067313 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 30 12:59:11.076554 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067315 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 30 12:59:11.076554 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067318 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 30 12:59:11.076554 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067321 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 30 12:59:11.076554 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067324 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 30 12:59:11.076554 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067326 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 30 12:59:11.076554 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067329 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 30 12:59:11.076554 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067331 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 30 12:59:11.076554 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067334 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 30 12:59:11.076554 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067336 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 30 12:59:11.076554 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067339 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 30 12:59:11.076554 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067341 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 30 12:59:11.077072 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067344 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 30 12:59:11.077072 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067346 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 30 12:59:11.077072 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067349 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 30 12:59:11.077072 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067352 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 30 12:59:11.077072 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067354 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 30 12:59:11.077072 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067357 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 30 12:59:11.077072 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067360 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 30 12:59:11.077072 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067363 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 30 12:59:11.077072 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067365 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 30 12:59:11.077072 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067369 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 30 12:59:11.077072 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067372 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 30 12:59:11.077072 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067374 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 30 12:59:11.077072 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067377 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 30 12:59:11.077072 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067381 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 30 12:59:11.077072 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067383 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 30 12:59:11.077072 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067386 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 30 12:59:11.077072 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067389 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 30 12:59:11.077072 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067392 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 30 12:59:11.077072 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067394 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 30 12:59:11.077544 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067397 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 30 12:59:11.077544 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067399 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 30 12:59:11.077544 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067402 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 30 12:59:11.077544 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067405 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 30 12:59:11.077544 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067407 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 30 12:59:11.077544 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067411 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 30 12:59:11.077544 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067413 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 30 12:59:11.077544 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067416 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 30 12:59:11.077544 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067418 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 30 12:59:11.077544 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067421 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 30 12:59:11.077544 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067423 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 30 12:59:11.077544 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067426 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 30 12:59:11.077544 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067428 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 30 12:59:11.077544 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067431 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 30 12:59:11.077544 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067434 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 30 12:59:11.077544 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067436 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 30 12:59:11.077544 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067439 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 30 12:59:11.077544 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067442 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 30 12:59:11.077544 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067444 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 30 12:59:11.077544 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067447 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 30 12:59:11.077544 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067449 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 30 12:59:11.078078 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067452 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 30 12:59:11.078078 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067456 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 30 12:59:11.078078 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067459 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 30 12:59:11.078078 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067461 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 30 12:59:11.078078 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067464 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 30 12:59:11.078078 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067468 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 30 12:59:11.078078 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067471 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 30 12:59:11.078078 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067473 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 30 12:59:11.078078 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067476 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 30 12:59:11.078078 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067480 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 30 12:59:11.078078 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067483 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 30 12:59:11.078078 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067486 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 30 12:59:11.078078 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067489 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 30 12:59:11.078078 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067492 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 30 12:59:11.078078 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067495 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 30 12:59:11.078078 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067497 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 30 12:59:11.078078 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067500 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 30 12:59:11.078078 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067504 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 30 12:59:11.078078 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067508 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 30 12:59:11.078545 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.067511 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 30 12:59:11.078545 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.068271 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 30 12:59:11.078545 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.075725 2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 30 12:59:11.078545 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.075742 2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 30 12:59:11.078545 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.075778 2579 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 30 12:59:11.078545 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.075784 2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 30 12:59:11.078545 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.075842 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 30 12:59:11.078545 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.075848 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 30 12:59:11.078545 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.075851 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 30 12:59:11.078545 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.075854 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 30 12:59:11.078545 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.075858 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 30 12:59:11.078545 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.075861 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 30 12:59:11.078545 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.075864 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 30 12:59:11.078545 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.075866 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 30 12:59:11.078545 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.075869 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 30 12:59:11.078922 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.075872 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 30 12:59:11.078922 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.075875 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 30 12:59:11.078922 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.075877 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 30 12:59:11.078922 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.075880 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 30 12:59:11.078922 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.075883 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 30 12:59:11.078922 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.075886 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 30 12:59:11.078922 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.075888 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 30 12:59:11.078922 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.075891 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 30 12:59:11.078922 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.075894 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 30 12:59:11.078922 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.075896 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 30 12:59:11.078922 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.075899 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 30 12:59:11.078922 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.075901 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 30 12:59:11.078922 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.075904 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 30 12:59:11.078922 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.075907 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 30 12:59:11.078922 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.075909 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 30 12:59:11.078922 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.075912 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 30 12:59:11.078922 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.075915 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 30 12:59:11.078922 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.075918 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 30 12:59:11.078922 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.075920 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 30 12:59:11.078922 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.075923 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 30 12:59:11.079512 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.075927 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 30 12:59:11.079512 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.075930 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 30 12:59:11.079512 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.075933 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 30 12:59:11.079512 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.075952 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 30 12:59:11.079512 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.075955 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 30 12:59:11.079512 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.075957 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 30 12:59:11.079512 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.075960 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 30 12:59:11.079512 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.075963 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 30 12:59:11.079512 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.075966 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 30 12:59:11.079512 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.075968 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 30 12:59:11.079512 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.075971 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 30 12:59:11.079512 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.075974 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 30 12:59:11.079512 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.075976 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 30 12:59:11.079512 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.075979 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 30 12:59:11.079512 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.075981 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 30 12:59:11.079512 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.075984 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 30 12:59:11.079512 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.075987 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 30 12:59:11.079512 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.075989 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 30 12:59:11.079512 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.075992 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 30 12:59:11.079512 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.075995 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 30 12:59:11.080016 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.075997 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 30 12:59:11.080016 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076000 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 30 12:59:11.080016 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076002 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 30 12:59:11.080016 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076005 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 30 12:59:11.080016 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076007 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 30 12:59:11.080016 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076010 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 30 12:59:11.080016 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076012 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 30 12:59:11.080016 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076015 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 30 12:59:11.080016 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076017 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 30 12:59:11.080016 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076021 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 30 12:59:11.080016 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076025 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 30 12:59:11.080016 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076028 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 30 12:59:11.080016 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076031 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 30 12:59:11.080016 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076034 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 30 12:59:11.080016 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076037 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 30 12:59:11.080016 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076040 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 30 12:59:11.080016 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076042 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 30 12:59:11.080016 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076045 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 30 12:59:11.080016 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076047 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 30 12:59:11.080016 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076050 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 30 12:59:11.080508 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076052 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 30 12:59:11.080508 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076055 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 30 12:59:11.080508 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076057 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 30 12:59:11.080508 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076060 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 30 12:59:11.080508 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076062 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 30 12:59:11.080508 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076065 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 30 12:59:11.080508 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076068 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 30 12:59:11.080508 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076070 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 30 12:59:11.080508 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076073 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 30 12:59:11.080508 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076077 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 30 12:59:11.080508 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076080 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 30 12:59:11.080508 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076084 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 30 12:59:11.080508 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076087 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 30 12:59:11.080508 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076089 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 30 12:59:11.080508 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076092 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 30 12:59:11.080508 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076095 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 30 12:59:11.080508 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076099 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 30 12:59:11.080508 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076102 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 30 12:59:11.080508 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076105 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 30 12:59:11.081022 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076108 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 30 12:59:11.081022 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076111 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 30 12:59:11.081022 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076114 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 30 12:59:11.081022 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076117 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 30 12:59:11.081022 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076120 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 30 12:59:11.081022 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076124 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 30 12:59:11.081022 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076126 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 30 12:59:11.081022 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076130 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 30 12:59:11.081022 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076132 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 30 12:59:11.081022 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076135 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 30 12:59:11.081022 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076138 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 30 12:59:11.081022 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.076143 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 30 12:59:11.081022 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076277 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 30 12:59:11.081022 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076281 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 30 12:59:11.081022 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076285 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 30 12:59:11.081514 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076288 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 30 12:59:11.081514 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076291 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 30 12:59:11.081514 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076293 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 30 12:59:11.081514 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076296 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 30 12:59:11.081514 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076299 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 30 12:59:11.081514 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076301 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 30 12:59:11.081514 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076304 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 30 12:59:11.081514 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076306 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 30 12:59:11.081514 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076308 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 30 12:59:11.081514 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076311 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 30 12:59:11.081514 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076313 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 30 12:59:11.081514 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076316 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 30 12:59:11.081514 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076318 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 30 12:59:11.081514 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076321 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 30 12:59:11.081514 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076323 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 30 12:59:11.081514 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076326 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 30 12:59:11.081514 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076328 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 30 12:59:11.081514 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076331 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 30 12:59:11.081514 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076333 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 30 12:59:11.081514 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076336 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 30 12:59:11.082072 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076338 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 30 12:59:11.082072 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076341 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 30 12:59:11.082072 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076344 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 30 12:59:11.082072 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076347 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 30 12:59:11.082072 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076350 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 30 12:59:11.082072 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076353 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 30 12:59:11.082072 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076356 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 30 12:59:11.082072 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076358 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 30 12:59:11.082072 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076361 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 30 12:59:11.082072 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076364 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 30 12:59:11.082072 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076366 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 30 12:59:11.082072 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076369 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 30 12:59:11.082072 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076371 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 30 12:59:11.082072 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076374 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 30 12:59:11.082072 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076376 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 30 12:59:11.082072 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076379 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 30 12:59:11.082072 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076382 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 30 12:59:11.082072 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076384 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 30 12:59:11.082072 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076387 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 30 12:59:11.082072 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076389 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 30 12:59:11.082855 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076392 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 30 12:59:11.082855 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076394 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 30 12:59:11.082855 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076397 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 30 12:59:11.082855 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076400 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 30 12:59:11.082855 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076404 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 30 12:59:11.082855 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076407 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 30 12:59:11.082855 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076410 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 30 12:59:11.082855 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076412 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 30 12:59:11.082855 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076415 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 30 12:59:11.082855 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076418 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 30 12:59:11.082855 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076420 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 30 12:59:11.082855 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076423 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 30 12:59:11.082855 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076426 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 30 12:59:11.082855 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076428 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 30 12:59:11.082855 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076431 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 30 12:59:11.082855 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076434 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 30 12:59:11.082855 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076436 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 30 12:59:11.082855 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076439 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 30 12:59:11.082855 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076442 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 30 12:59:11.083347 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076444 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 30 12:59:11.083347 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076447 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 30 12:59:11.083347 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076449 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 30 12:59:11.083347 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076452 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 30 12:59:11.083347 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076454 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 30 12:59:11.083347 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076457 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 30 12:59:11.083347 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076459 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 30 12:59:11.083347 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076462 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 30 12:59:11.083347 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076464 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 30 12:59:11.083347 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076467 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 30 12:59:11.083347 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076469 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 30 12:59:11.083347 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076472 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 30 12:59:11.083347 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076476 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 30 12:59:11.083347 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076479 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 30 12:59:11.083347 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076482 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 30 12:59:11.083347 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076485 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 30 12:59:11.083347 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076488 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 30 12:59:11.083347 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076490 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 30 12:59:11.083347 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076493 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 30 12:59:11.083952 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076496 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 30 12:59:11.083952 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076498 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 30 12:59:11.083952 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076501 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 30 12:59:11.083952 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076503 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 30 12:59:11.083952 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076506 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 30 12:59:11.083952 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076508 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 30 12:59:11.083952 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076511 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 30 12:59:11.083952 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076513 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 30 12:59:11.083952 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076516 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 30 12:59:11.083952 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076519 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 30 12:59:11.083952 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076523 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 30 12:59:11.083952 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076525 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 30 12:59:11.083952 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076528 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 30 12:59:11.083952 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076531 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 30 12:59:11.083952 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076534 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 30 12:59:11.083952 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076536 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 30 12:59:11.083952 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076539 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 30 12:59:11.083952 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:11.076541 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 30 12:59:11.084405 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.076546 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 30 12:59:11.084405 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.076678 2579 server.go:962] "Client rotation is on, will bootstrap in background" Jul 30 12:59:11.084405 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.079131 2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 30 12:59:11.084405 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.080857 2579 server.go:1019] "Starting client certificate rotation" Jul 30 12:59:11.084405 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.080973 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 30 12:59:11.084405 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.081023 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 30 12:59:11.084405 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.083765 2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 30 12:59:11.089284 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.089262 2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 30 12:59:11.106694 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.106668 2579 log.go:25] "Validated CRI v1 runtime API" Jul 30 12:59:11.109392 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.109374 2579 log.go:25] "Validated CRI v1 image API" Jul 30 12:59:11.110239 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.110219 2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 30 12:59:11.112905 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.112882 2579 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 addbbd9d-72ae-4c3d-9b5c-0f5a429eedfa:/dev/nvme0n1p3 d179efd1-a2c1-42e3-8962-fd8d250f03c4:/dev/nvme0n1p4] Jul 30 12:59:11.113011 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.112902 2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 30 12:59:11.114316 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.114299 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 30 12:59:11.118688 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.118563 2579 manager.go:216] Machine: {Timestamp:2026-07-30 12:59:11.117120896 +0000 UTC m=+0.362064832 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099858 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec221d800187a6e7637df154c14610c3 SystemUUID:ec221d80-0187-a6e7-637d-f154c14610c3 BootID:764e5dbe-d678-4fa6-9843-96de0f50856d Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:a7:6f:3b:7b:17 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:a7:6f:3b:7b:17 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:52:51:28:b3:c8:51 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 30 12:59:11.118688 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.118680 2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 30 12:59:11.118839 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.118814 2579 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 30 12:59:11.120061 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.120032 2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 30 12:59:11.120206 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.120063 2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-230.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 30 12:59:11.120997 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.120983 2579 topology_manager.go:138] "Creating topology manager with none policy" Jul 30 12:59:11.121034 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.120998 2579 container_manager_linux.go:309] "Creating device plugin manager" Jul 30 12:59:11.121034 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.121011 2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 30 12:59:11.121854 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.121842 2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 30 12:59:11.123175 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.123164 2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 30 12:59:11.126179 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.126164 2579 state_mem.go:36] "Initialized new in-memory state store" Jul 30 12:59:11.126330 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.126320 2579 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 30 12:59:11.126360 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.126354 2579 kubelet.go:486] "Attempting to sync node with API server" Jul 30 12:59:11.126390 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.126368 2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 30 12:59:11.126417 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.126398 2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 30 12:59:11.126417 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.126411 2579 kubelet.go:398] "Adding apiserver pod source" Jul 30 12:59:11.126474 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.126428 2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 30 12:59:11.126951 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.126928 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 30 12:59:11.127024 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.126960 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 30 12:59:11.129429 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.129411 2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 30 12:59:11.132010 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.131994 2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 30 12:59:11.132090 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.132025 2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 30 12:59:11.134113 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.134092 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 30 12:59:11.134113 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.134110 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 30 12:59:11.134113 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.134117 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 30 12:59:11.134331 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.134124 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 30 12:59:11.134331 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.134138 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 30 12:59:11.134331 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.134146 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 30 12:59:11.134331 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.134157 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 30 12:59:11.134331 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.134162 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 30 12:59:11.134331 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.134168 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 30 12:59:11.134331 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.134174 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 30 12:59:11.134331 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.134183 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 30 12:59:11.134331 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.134189 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 30 12:59:11.134983 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.134971 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 30 12:59:11.134983 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.134983 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 30 12:59:11.138705 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.138677 2579 server.go:1268] "Started kubelet" Jul 30 12:59:11.138834 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.138791 2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 30 12:59:11.138994 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:11.138962 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-230.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 30 12:59:11.139112 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.139094 2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-230.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 30 12:59:11.139179 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:11.139140 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 30 12:59:11.139229 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.139173 2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 30 12:59:11.139287 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.139271 2579 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 30 12:59:11.141386 ip-10-0-133-230 systemd[1]: Started Kubernetes Kubelet. Jul 30 12:59:11.145527 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.145395 2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 30 12:59:11.147501 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:11.147452 2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 30 12:59:11.148369 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.148353 2579 server.go:310] "Adding debug handlers to kubelet server" Jul 30 12:59:11.150342 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:11.148032 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-230.ec2.internal.18c712b639cb1366 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-230.ec2.internal,UID:ip-10-0-133-230.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-230.ec2.internal,},FirstTimestamp:2026-07-30 12:59:11.138648934 +0000 UTC m=+0.383592869,LastTimestamp:2026-07-30 12:59:11.138648934 +0000 UTC m=+0.383592869,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-230.ec2.internal,}" Jul 30 12:59:11.154471 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.154450 2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 30 12:59:11.154471 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.154464 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 30 12:59:11.154714 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:11.154648 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-230.ec2.internal\" not found" Jul 30 12:59:11.155234 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.155212 2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 30 12:59:11.155327 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.155214 2579 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 30 12:59:11.155327 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.155299 2579 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 30 12:59:11.155443 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.155431 2579 factory.go:55] Registering systemd factory Jul 30 12:59:11.155494 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.155449 2579 factory.go:223] Registration of the systemd container factory successfully Jul 30 12:59:11.155494 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.155436 2579 reconstruct.go:97] "Volume reconstruction finished" Jul 30 12:59:11.155494 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.155463 2579 reconciler.go:29] "Reconciler: start to sync state" Jul 30 12:59:11.155673 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.155659 2579 factory.go:153] Registering CRI-O factory Jul 30 12:59:11.155723 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.155678 2579 factory.go:223] Registration of the crio container factory successfully Jul 30 12:59:11.155774 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.155737 2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 30 12:59:11.155774 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.155764 2579 factory.go:103] Registering Raw factory Jul 30 12:59:11.155862 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.155779 2579 manager.go:1196] Started watching for new ooms in manager Jul 30 12:59:11.157529 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:11.157504 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 30 12:59:11.157628 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.157562 2579 manager.go:349] Starting recovery of all containers Jul 30 12:59:11.158474 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.158451 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xl447" Jul 30 12:59:11.163679 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.163647 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 30 12:59:11.166407 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.166381 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xl447" Jul 30 12:59:11.167786 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:11.167760 2579 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-230.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 30 12:59:11.169861 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.168923 2579 manager.go:354] Recovery completed Jul 30 12:59:11.173180 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.173167 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 30 12:59:11.175084 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.175068 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-230.ec2.internal" event="NodeHasSufficientMemory" Jul 30 12:59:11.175145 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.175100 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-230.ec2.internal" event="NodeHasNoDiskPressure" Jul 30 12:59:11.175145 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.175111 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-230.ec2.internal" event="NodeHasSufficientPID" Jul 30 12:59:11.175664 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.175647 2579 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 30 12:59:11.175664 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.175664 2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 30 12:59:11.175793 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.175680 2579 state_mem.go:36] "Initialized new in-memory state store" Jul 30 12:59:11.175793 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.175693 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 30 12:59:11.177495 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.177479 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-230.ec2.internal" event="NodeHasSufficientMemory" Jul 30 12:59:11.177588 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.177509 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-230.ec2.internal" event="NodeHasNoDiskPressure" Jul 30 12:59:11.177588 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.177519 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-230.ec2.internal" event="NodeHasSufficientPID" Jul 30 12:59:11.178311 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.178298 2579 policy_none.go:49] "None policy: Start" Jul 30 12:59:11.178362 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.178323 2579 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 30 12:59:11.178362 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.178337 2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 30 12:59:11.180350 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.180337 2579 policy_none.go:47] "Start" Jul 30 12:59:11.209626 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.209609 2579 manager.go:337] "Starting Device Plugin manager" Jul 30 12:59:11.209737 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:11.209640 2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 30 12:59:11.209737 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.209651 2579 server.go:87] "Starting device plugin registration server" Jul 30 12:59:11.209953 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.209926 2579 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 30 12:59:11.210004 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.209958 2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 30 12:59:11.210065 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.210044 2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 30 12:59:11.210141 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.210129 2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 30 12:59:11.210141 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.210142 2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 30 12:59:11.210721 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:11.210679 2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 30 12:59:11.210821 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:11.210731 2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-230.ec2.internal\" not found" Jul 30 12:59:11.287283 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.287101 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 30 12:59:11.287450 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.287314 2579 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 30 12:59:11.287450 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.287344 2579 kubelet.go:2448] "Starting kubelet main sync loop" Jul 30 12:59:11.287450 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:11.287392 2579 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 30 12:59:11.289383 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.289363 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 30 12:59:11.310114 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.310054 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 30 12:59:11.310986 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.310970 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-230.ec2.internal" event="NodeHasSufficientMemory" Jul 30 12:59:11.311054 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.311000 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-230.ec2.internal" event="NodeHasNoDiskPressure" Jul 30 12:59:11.311054 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.311011 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-230.ec2.internal" event="NodeHasSufficientPID" Jul 30 12:59:11.311054 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.311035 2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-230.ec2.internal" Jul 30 12:59:11.321695 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.321676 2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-230.ec2.internal" Jul 30 12:59:11.321797 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:11.321700 2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-230.ec2.internal\": node \"ip-10-0-133-230.ec2.internal\" not found" Jul 30 12:59:11.343973 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:11.343948 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-230.ec2.internal\" not found" Jul 30 12:59:11.388371 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.388343 2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-230.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-230.ec2.internal"] Jul 30 12:59:11.388492 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.388425 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 30 12:59:11.389427 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.389405 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-230.ec2.internal" event="NodeHasSufficientMemory" Jul 30 12:59:11.389531 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.389437 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-230.ec2.internal" event="NodeHasNoDiskPressure" Jul 30 12:59:11.389531 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.389447 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-230.ec2.internal" event="NodeHasSufficientPID" Jul 30 12:59:11.391817 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.391805 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 30 12:59:11.391926 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.391911 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-230.ec2.internal" Jul 30 12:59:11.391981 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.391961 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 30 12:59:11.392608 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.392593 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-230.ec2.internal" event="NodeHasSufficientMemory" Jul 30 12:59:11.392693 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.392605 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-230.ec2.internal" event="NodeHasSufficientMemory" Jul 30 12:59:11.392693 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.392616 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-230.ec2.internal" event="NodeHasNoDiskPressure" Jul 30 12:59:11.392693 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.392626 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-230.ec2.internal" event="NodeHasSufficientPID" Jul 30 12:59:11.392693 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.392629 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-230.ec2.internal" event="NodeHasNoDiskPressure" Jul 30 12:59:11.392693 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.392638 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-230.ec2.internal" event="NodeHasSufficientPID" Jul 30 12:59:11.394884 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.394870 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-230.ec2.internal" Jul 30 12:59:11.394933 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.394896 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 30 12:59:11.395565 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.395548 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-230.ec2.internal" event="NodeHasSufficientMemory" Jul 30 12:59:11.395662 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.395577 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-230.ec2.internal" event="NodeHasNoDiskPressure" Jul 30 12:59:11.395662 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.395591 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-230.ec2.internal" event="NodeHasSufficientPID" Jul 30 12:59:11.418646 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:11.418621 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-230.ec2.internal\" not found" node="ip-10-0-133-230.ec2.internal" Jul 30 12:59:11.422857 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:11.422838 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-230.ec2.internal\" not found" node="ip-10-0-133-230.ec2.internal" Jul 30 12:59:11.444639 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:11.444607 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-230.ec2.internal\" not found" Jul 30 12:59:11.457533 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.457505 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/66d7deccf1aa4e927a9cf89772adac78-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-230.ec2.internal\" (UID: \"66d7deccf1aa4e927a9cf89772adac78\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-230.ec2.internal" Jul 30 12:59:11.457609 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.457540 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/66d7deccf1aa4e927a9cf89772adac78-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-230.ec2.internal\" (UID: \"66d7deccf1aa4e927a9cf89772adac78\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-230.ec2.internal" Jul 30 12:59:11.457609 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.457561 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b39ac35dac0bf47dea91e3680de30c40-config\") pod \"kube-apiserver-proxy-ip-10-0-133-230.ec2.internal\" (UID: \"b39ac35dac0bf47dea91e3680de30c40\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-230.ec2.internal" Jul 30 12:59:11.544987 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:11.544920 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-230.ec2.internal\" not found" Jul 30 12:59:11.558324 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.558297 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/66d7deccf1aa4e927a9cf89772adac78-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-230.ec2.internal\" (UID: \"66d7deccf1aa4e927a9cf89772adac78\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-230.ec2.internal" Jul 30 12:59:11.558402 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.558333 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/66d7deccf1aa4e927a9cf89772adac78-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-230.ec2.internal\" (UID: \"66d7deccf1aa4e927a9cf89772adac78\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-230.ec2.internal" Jul 30 12:59:11.558402 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.558352 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b39ac35dac0bf47dea91e3680de30c40-config\") pod \"kube-apiserver-proxy-ip-10-0-133-230.ec2.internal\" (UID: \"b39ac35dac0bf47dea91e3680de30c40\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-230.ec2.internal" Jul 30 12:59:11.558402 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.558397 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/66d7deccf1aa4e927a9cf89772adac78-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-230.ec2.internal\" (UID: \"66d7deccf1aa4e927a9cf89772adac78\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-230.ec2.internal" Jul 30 12:59:11.558495 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.558403 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b39ac35dac0bf47dea91e3680de30c40-config\") pod \"kube-apiserver-proxy-ip-10-0-133-230.ec2.internal\" (UID: \"b39ac35dac0bf47dea91e3680de30c40\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-230.ec2.internal" Jul 30 12:59:11.558495 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.558442 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/66d7deccf1aa4e927a9cf89772adac78-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-230.ec2.internal\" (UID: \"66d7deccf1aa4e927a9cf89772adac78\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-230.ec2.internal" Jul 30 12:59:11.645842 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:11.645754 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-230.ec2.internal\" not found" Jul 30 12:59:11.721354 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.721325 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-230.ec2.internal" Jul 30 12:59:11.726365 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:11.726272 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-230.ec2.internal" Jul 30 12:59:11.746596 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:11.746565 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-230.ec2.internal\" not found" Jul 30 12:59:11.847131 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:11.847091 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-230.ec2.internal\" not found" Jul 30 12:59:11.947690 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:11.947619 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-230.ec2.internal\" not found" Jul 30 12:59:13.461777 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:13.461746 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-230.ec2.internal\" not found" Jul 30 12:59:13.493255 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:13.493220 2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 30 12:59:13.493754 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:13.493402 2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 30 12:59:13.542020 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:13.541995 2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 30 12:59:13.562220 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:13.562193 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-230.ec2.internal\" not found" Jul 30 12:59:13.587240 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:13.587207 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-29 12:54:12 +0000 UTC" deadline="2028-01-10 02:08:51.619303226 +0000 UTC" Jul 30 12:59:13.587240 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:13.587233 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12685h9m38.032073085s" Jul 30 12:59:13.662593 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:13.662558 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-230.ec2.internal\" not found" Jul 30 12:59:13.721017 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:13.720995 2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 30 12:59:13.763141 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:13.763116 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-230.ec2.internal\" not found" Jul 30 12:59:13.772163 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:13.772129 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb39ac35dac0bf47dea91e3680de30c40.slice/crio-fe58b38b6363022af700f091607b02843c86a329e58307048baaf3121075417a WatchSource:0}: Error finding container fe58b38b6363022af700f091607b02843c86a329e58307048baaf3121075417a: Status 404 returned error can't find the container with id fe58b38b6363022af700f091607b02843c86a329e58307048baaf3121075417a Jul 30 12:59:13.772754 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:13.772728 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66d7deccf1aa4e927a9cf89772adac78.slice/crio-644485e0e3f83ce0db0d4ac292baf67b3f0c0e5493aba0b584b6286a72524b59 WatchSource:0}: Error finding container 644485e0e3f83ce0db0d4ac292baf67b3f0c0e5493aba0b584b6286a72524b59: Status 404 returned error can't find the container with id 644485e0e3f83ce0db0d4ac292baf67b3f0c0e5493aba0b584b6286a72524b59 Jul 30 12:59:13.777306 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:13.777286 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 30 12:59:13.863681 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:13.863641 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-230.ec2.internal\" not found" Jul 30 12:59:13.868700 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:13.868684 2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 30 12:59:13.969169 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:13.969146 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-230.ec2.internal" Jul 30 12:59:13.985739 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:13.985722 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 30 12:59:13.986626 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:13.986613 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-230.ec2.internal" Jul 30 12:59:13.999454 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:13.999432 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 30 12:59:14.541129 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.541098 2579 apiserver.go:52] "Watching apiserver" Jul 30 12:59:14.550087 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.550051 2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 30 12:59:14.553353 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.552671 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-rlk59","openshift-ovn-kubernetes/ovnkube-node-zkflm","kube-system/konnectivity-agent-cbrzj","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nvcpn","openshift-cluster-node-tuning-operator/tuned-24667","openshift-dns/node-resolver-x7bbz","openshift-multus/multus-5nn6b","openshift-multus/multus-additional-cni-plugins-228r4","openshift-multus/network-metrics-daemon-mrfm9","kube-system/global-pull-secret-syncer-xzq9h","kube-system/kube-apiserver-proxy-ip-10-0-133-230.ec2.internal","openshift-image-registry/node-ca-9cpnl","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-230.ec2.internal","openshift-network-diagnostics/network-check-target-8vppx"] Jul 30 12:59:14.555399 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.555377 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rlk59" Jul 30 12:59:14.558908 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.558882 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zkflm" Jul 30 12:59:14.559092 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.559073 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-gfj8m\"" Jul 30 12:59:14.559282 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.559251 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 30 12:59:14.559282 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.559279 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 30 12:59:14.559779 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.559758 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 30 12:59:14.561318 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.561204 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vppx" Jul 30 12:59:14.561318 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:14.561280 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vppx" podUID="24802bd2-a87c-440d-8ce9-1ef4780224d4" Jul 30 12:59:14.562656 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.561931 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 30 12:59:14.562656 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.562281 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 30 12:59:14.562656 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.562427 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 30 12:59:14.562855 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.562692 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 30 12:59:14.564032 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.563504 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 30 12:59:14.564032 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.563518 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-bsvnp\"" Jul 30 12:59:14.564032 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.563721 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 30 12:59:14.565117 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.564612 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nvcpn" Jul 30 12:59:14.567474 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.566579 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-24667" Jul 30 12:59:14.567474 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.567086 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 30 12:59:14.567615 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.567481 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 30 12:59:14.567961 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.567676 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-72zcs\"" Jul 30 12:59:14.567961 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.567725 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 30 12:59:14.567961 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.567678 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 30 12:59:14.569081 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.568810 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 30 12:59:14.569081 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.568977 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-x7bbz" Jul 30 12:59:14.569831 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.569805 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 30 12:59:14.570328 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.570134 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-cvrlb\"" Jul 30 12:59:14.570328 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.570196 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 30 12:59:14.571520 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.571501 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5nn6b" Jul 30 12:59:14.573978 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.573944 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 30 12:59:14.574076 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.573996 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 30 12:59:14.574397 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.574374 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 30 12:59:14.574597 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.574544 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 30 12:59:14.575376 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.574743 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-228r4" Jul 30 12:59:14.575376 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.575120 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-gw6dk\"" Jul 30 12:59:14.575376 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.575150 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 30 12:59:14.575376 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.575246 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 30 12:59:14.575376 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.575300 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ssztn\"" Jul 30 12:59:14.576912 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.576893 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrfm9" Jul 30 12:59:14.577002 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:14.576964 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrfm9" podUID="b4467d9b-3531-4231-8fa2-278fec9b2f6d" Jul 30 12:59:14.577638 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.577344 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 30 12:59:14.577638 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.577392 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 30 12:59:14.577638 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.577344 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-mzt7l\"" Jul 30 12:59:14.579528 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.579411 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xzq9h" Jul 30 12:59:14.579528 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:14.579493 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xzq9h" podUID="e4027c79-c8b8-4800-9db1-843170f52290" Jul 30 12:59:14.581109 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.580935 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b-hostroot\") pod \"multus-5nn6b\" (UID: \"1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b\") " pod="openshift-multus/multus-5nn6b" Jul 30 12:59:14.581109 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.580972 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077-run-openvswitch\") pod \"ovnkube-node-zkflm\" (UID: \"e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-zkflm" Jul 30 12:59:14.581109 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.580999 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zkflm\" (UID: \"e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-zkflm" Jul 30 12:59:14.581109 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.581022 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077-env-overrides\") pod \"ovnkube-node-zkflm\" (UID: \"e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-zkflm" Jul 30 12:59:14.581109 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.581046 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ab45ff61-9eb3-4269-8007-d1e68fe130bc-registration-dir\") pod \"aws-ebs-csi-driver-node-nvcpn\" (UID: \"ab45ff61-9eb3-4269-8007-d1e68fe130bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nvcpn" Jul 30 12:59:14.581109 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.581070 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4debd6c2-458e-46b6-9ac0-3aebd006c681-run\") pod \"tuned-24667\" (UID: \"4debd6c2-458e-46b6-9ac0-3aebd006c681\") " pod="openshift-cluster-node-tuning-operator/tuned-24667" Jul 30 12:59:14.581109 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.581111 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4debd6c2-458e-46b6-9ac0-3aebd006c681-sys\") pod \"tuned-24667\" (UID: \"4debd6c2-458e-46b6-9ac0-3aebd006c681\") " pod="openshift-cluster-node-tuning-operator/tuned-24667" Jul 30 12:59:14.581459 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.581137 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077-node-log\") pod \"ovnkube-node-zkflm\" (UID: \"e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-zkflm" Jul 30 12:59:14.581459 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.581160 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ab45ff61-9eb3-4269-8007-d1e68fe130bc-device-dir\") pod \"aws-ebs-csi-driver-node-nvcpn\" (UID: \"ab45ff61-9eb3-4269-8007-d1e68fe130bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nvcpn" Jul 30 12:59:14.581459 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.581184 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b-os-release\") pod \"multus-5nn6b\" (UID: \"1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b\") " pod="openshift-multus/multus-5nn6b" Jul 30 12:59:14.581459 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.581207 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b-multus-socket-dir-parent\") pod \"multus-5nn6b\" (UID: \"1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b\") " pod="openshift-multus/multus-5nn6b" Jul 30 12:59:14.581459 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.581231 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dg54k\" (UniqueName: \"kubernetes.io/projected/1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b-kube-api-access-dg54k\") pod \"multus-5nn6b\" (UID: \"1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b\") " pod="openshift-multus/multus-5nn6b" Jul 30 12:59:14.581459 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.581254 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077-host-run-ovn-kubernetes\") pod \"ovnkube-node-zkflm\" (UID: \"e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-zkflm" Jul 30 12:59:14.581459 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.581279 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmqpw\" (UniqueName: \"kubernetes.io/projected/ab45ff61-9eb3-4269-8007-d1e68fe130bc-kube-api-access-kmqpw\") pod \"aws-ebs-csi-driver-node-nvcpn\" (UID: \"ab45ff61-9eb3-4269-8007-d1e68fe130bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nvcpn" Jul 30 12:59:14.581459 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.581304 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b-system-cni-dir\") pod \"multus-5nn6b\" (UID: \"1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b\") " pod="openshift-multus/multus-5nn6b" Jul 30 12:59:14.581459 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.581329 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b-host-var-lib-cni-multus\") pod \"multus-5nn6b\" (UID: \"1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b\") " pod="openshift-multus/multus-5nn6b" Jul 30 12:59:14.581459 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.581352 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077-etc-openvswitch\") pod \"ovnkube-node-zkflm\" (UID: \"e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-zkflm" Jul 30 12:59:14.581459 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.581375 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ab45ff61-9eb3-4269-8007-d1e68fe130bc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nvcpn\" (UID: \"ab45ff61-9eb3-4269-8007-d1e68fe130bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nvcpn" Jul 30 12:59:14.581459 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.581398 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4debd6c2-458e-46b6-9ac0-3aebd006c681-lib-modules\") pod \"tuned-24667\" (UID: \"4debd6c2-458e-46b6-9ac0-3aebd006c681\") " pod="openshift-cluster-node-tuning-operator/tuned-24667" Jul 30 12:59:14.581459 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.581439 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0659b9a4-1828-4bd3-a1d9-b493d7fd6693-host-slash\") pod \"iptables-alerter-rlk59\" (UID: \"0659b9a4-1828-4bd3-a1d9-b493d7fd6693\") " pod="openshift-network-operator/iptables-alerter-rlk59" Jul 30 12:59:14.582114 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.581469 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2g8f7\" (UniqueName: \"kubernetes.io/projected/0659b9a4-1828-4bd3-a1d9-b493d7fd6693-kube-api-access-2g8f7\") pod \"iptables-alerter-rlk59\" (UID: \"0659b9a4-1828-4bd3-a1d9-b493d7fd6693\") " pod="openshift-network-operator/iptables-alerter-rlk59" Jul 30 12:59:14.582114 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.581495 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b-host-var-lib-cni-bin\") pod \"multus-5nn6b\" (UID: \"1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b\") " pod="openshift-multus/multus-5nn6b" Jul 30 12:59:14.582114 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.581517 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077-var-lib-openvswitch\") pod \"ovnkube-node-zkflm\" (UID: \"e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-zkflm" Jul 30 12:59:14.582114 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.581533 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4debd6c2-458e-46b6-9ac0-3aebd006c681-etc-sysconfig\") pod \"tuned-24667\" (UID: \"4debd6c2-458e-46b6-9ac0-3aebd006c681\") " pod="openshift-cluster-node-tuning-operator/tuned-24667" Jul 30 12:59:14.582114 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.581551 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4debd6c2-458e-46b6-9ac0-3aebd006c681-etc-tuned\") pod \"tuned-24667\" (UID: \"4debd6c2-458e-46b6-9ac0-3aebd006c681\") " pod="openshift-cluster-node-tuning-operator/tuned-24667" Jul 30 12:59:14.582114 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.581570 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077-systemd-units\") pod \"ovnkube-node-zkflm\" (UID: \"e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-zkflm" Jul 30 12:59:14.582114 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.581588 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077-host-slash\") pod \"ovnkube-node-zkflm\" (UID: \"e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-zkflm" Jul 30 12:59:14.582114 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.581617 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b-multus-cni-dir\") pod \"multus-5nn6b\" (UID: \"1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b\") " pod="openshift-multus/multus-5nn6b" Jul 30 12:59:14.582114 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.581640 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b-host-run-k8s-cni-cncf-io\") pod \"multus-5nn6b\" (UID: \"1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b\") " pod="openshift-multus/multus-5nn6b" Jul 30 12:59:14.582114 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.581655 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b-multus-daemon-config\") pod \"multus-5nn6b\" (UID: \"1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b\") " pod="openshift-multus/multus-5nn6b" Jul 30 12:59:14.582114 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.581670 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnbjj\" (UniqueName: \"kubernetes.io/projected/e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077-kube-api-access-vnbjj\") pod \"ovnkube-node-zkflm\" (UID: \"e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-zkflm" Jul 30 12:59:14.582114 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.581689 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4debd6c2-458e-46b6-9ac0-3aebd006c681-var-lib-kubelet\") pod \"tuned-24667\" (UID: \"4debd6c2-458e-46b6-9ac0-3aebd006c681\") " pod="openshift-cluster-node-tuning-operator/tuned-24667" Jul 30 12:59:14.582114 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.581704 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b-host-run-multus-certs\") pod \"multus-5nn6b\" (UID: \"1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b\") " pod="openshift-multus/multus-5nn6b" Jul 30 12:59:14.582114 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.581719 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b-etc-kubernetes\") pod \"multus-5nn6b\" (UID: \"1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b\") " pod="openshift-multus/multus-5nn6b" Jul 30 12:59:14.582114 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.581733 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077-ovn-node-metrics-cert\") pod \"ovnkube-node-zkflm\" (UID: \"e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-zkflm" Jul 30 12:59:14.582114 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.581748 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xh2jr\" (UniqueName: \"kubernetes.io/projected/4debd6c2-458e-46b6-9ac0-3aebd006c681-kube-api-access-xh2jr\") pod \"tuned-24667\" (UID: \"4debd6c2-458e-46b6-9ac0-3aebd006c681\") " pod="openshift-cluster-node-tuning-operator/tuned-24667" Jul 30 12:59:14.582850 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.581764 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0659b9a4-1828-4bd3-a1d9-b493d7fd6693-iptables-alerter-script\") pod \"iptables-alerter-rlk59\" (UID: \"0659b9a4-1828-4bd3-a1d9-b493d7fd6693\") " pod="openshift-network-operator/iptables-alerter-rlk59" Jul 30 12:59:14.582850 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.581779 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077-ovnkube-config\") pod \"ovnkube-node-zkflm\" (UID: \"e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-zkflm" Jul 30 12:59:14.582850 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.581814 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4debd6c2-458e-46b6-9ac0-3aebd006c681-tmp\") pod \"tuned-24667\" (UID: \"4debd6c2-458e-46b6-9ac0-3aebd006c681\") " pod="openshift-cluster-node-tuning-operator/tuned-24667" Jul 30 12:59:14.582850 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.581843 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077-run-ovn\") pod \"ovnkube-node-zkflm\" (UID: \"e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-zkflm" Jul 30 12:59:14.582850 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.581868 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2c2lf\" (UniqueName: \"kubernetes.io/projected/24802bd2-a87c-440d-8ce9-1ef4780224d4-kube-api-access-2c2lf\") pod \"network-check-target-8vppx\" (UID: \"24802bd2-a87c-440d-8ce9-1ef4780224d4\") " pod="openshift-network-diagnostics/network-check-target-8vppx" Jul 30 12:59:14.582850 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.581945 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ab45ff61-9eb3-4269-8007-d1e68fe130bc-sys-fs\") pod \"aws-ebs-csi-driver-node-nvcpn\" (UID: \"ab45ff61-9eb3-4269-8007-d1e68fe130bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nvcpn" Jul 30 12:59:14.582850 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.581991 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4debd6c2-458e-46b6-9ac0-3aebd006c681-etc-sysctl-conf\") pod \"tuned-24667\" (UID: \"4debd6c2-458e-46b6-9ac0-3aebd006c681\") " pod="openshift-cluster-node-tuning-operator/tuned-24667" Jul 30 12:59:14.582850 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.582022 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b-cni-binary-copy\") pod \"multus-5nn6b\" (UID: \"1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b\") " pod="openshift-multus/multus-5nn6b" Jul 30 12:59:14.582850 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.582056 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b-host-var-lib-kubelet\") pod \"multus-5nn6b\" (UID: \"1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b\") " pod="openshift-multus/multus-5nn6b" Jul 30 12:59:14.582850 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.582080 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ab45ff61-9eb3-4269-8007-d1e68fe130bc-etc-selinux\") pod \"aws-ebs-csi-driver-node-nvcpn\" (UID: \"ab45ff61-9eb3-4269-8007-d1e68fe130bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nvcpn" Jul 30 12:59:14.582850 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.582110 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4d9b0b7-6474-457f-b742-05d47589d56f-tmp-dir\") pod \"node-resolver-x7bbz\" (UID: \"a4d9b0b7-6474-457f-b742-05d47589d56f\") " pod="openshift-dns/node-resolver-x7bbz" Jul 30 12:59:14.582850 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.582137 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b-host-run-netns\") pod \"multus-5nn6b\" (UID: \"1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b\") " pod="openshift-multus/multus-5nn6b" Jul 30 12:59:14.582850 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.582159 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077-host-kubelet\") pod \"ovnkube-node-zkflm\" (UID: \"e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-zkflm" Jul 30 12:59:14.582850 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.582181 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077-log-socket\") pod \"ovnkube-node-zkflm\" (UID: \"e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-zkflm" Jul 30 12:59:14.582850 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.582216 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077-ovnkube-script-lib\") pod \"ovnkube-node-zkflm\" (UID: \"e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-zkflm" Jul 30 12:59:14.582850 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.582241 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ab45ff61-9eb3-4269-8007-d1e68fe130bc-socket-dir\") pod \"aws-ebs-csi-driver-node-nvcpn\" (UID: \"ab45ff61-9eb3-4269-8007-d1e68fe130bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nvcpn" Jul 30 12:59:14.583688 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.582273 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4debd6c2-458e-46b6-9ac0-3aebd006c681-etc-systemd\") pod \"tuned-24667\" (UID: \"4debd6c2-458e-46b6-9ac0-3aebd006c681\") " pod="openshift-cluster-node-tuning-operator/tuned-24667" Jul 30 12:59:14.583688 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.582296 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b-multus-conf-dir\") pod \"multus-5nn6b\" (UID: \"1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b\") " pod="openshift-multus/multus-5nn6b" Jul 30 12:59:14.583688 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.582317 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077-host-cni-bin\") pod \"ovnkube-node-zkflm\" (UID: \"e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-zkflm" Jul 30 12:59:14.583688 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.582350 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4debd6c2-458e-46b6-9ac0-3aebd006c681-host\") pod \"tuned-24667\" (UID: \"4debd6c2-458e-46b6-9ac0-3aebd006c681\") " pod="openshift-cluster-node-tuning-operator/tuned-24667" Jul 30 12:59:14.583688 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.582402 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6zll\" (UniqueName: \"kubernetes.io/projected/a4d9b0b7-6474-457f-b742-05d47589d56f-kube-api-access-v6zll\") pod \"node-resolver-x7bbz\" (UID: \"a4d9b0b7-6474-457f-b742-05d47589d56f\") " pod="openshift-dns/node-resolver-x7bbz" Jul 30 12:59:14.583688 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.582445 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077-run-systemd\") pod \"ovnkube-node-zkflm\" (UID: \"e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-zkflm" Jul 30 12:59:14.583688 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.582468 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4debd6c2-458e-46b6-9ac0-3aebd006c681-etc-kubernetes\") pod \"tuned-24667\" (UID: \"4debd6c2-458e-46b6-9ac0-3aebd006c681\") " pod="openshift-cluster-node-tuning-operator/tuned-24667" Jul 30 12:59:14.583688 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.582490 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4debd6c2-458e-46b6-9ac0-3aebd006c681-etc-sysctl-d\") pod \"tuned-24667\" (UID: \"4debd6c2-458e-46b6-9ac0-3aebd006c681\") " pod="openshift-cluster-node-tuning-operator/tuned-24667" Jul 30 12:59:14.583688 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.582511 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b-cnibin\") pod \"multus-5nn6b\" (UID: \"1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b\") " pod="openshift-multus/multus-5nn6b" Jul 30 12:59:14.583688 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.582534 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077-host-run-netns\") pod \"ovnkube-node-zkflm\" (UID: \"e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-zkflm" Jul 30 12:59:14.583688 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.582557 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077-host-cni-netd\") pod \"ovnkube-node-zkflm\" (UID: \"e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-zkflm" Jul 30 12:59:14.583688 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.582583 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4debd6c2-458e-46b6-9ac0-3aebd006c681-etc-modprobe-d\") pod \"tuned-24667\" (UID: \"4debd6c2-458e-46b6-9ac0-3aebd006c681\") " pod="openshift-cluster-node-tuning-operator/tuned-24667" Jul 30 12:59:14.583688 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.582605 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a4d9b0b7-6474-457f-b742-05d47589d56f-hosts-file\") pod \"node-resolver-x7bbz\" (UID: \"a4d9b0b7-6474-457f-b742-05d47589d56f\") " pod="openshift-dns/node-resolver-x7bbz" Jul 30 12:59:14.584278 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.583710 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 30 12:59:14.584278 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.583771 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9cpnl" Jul 30 12:59:14.585491 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.585473 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cbrzj" Jul 30 12:59:14.586979 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.586929 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 30 12:59:14.587608 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.587587 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 30 12:59:14.587718 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.587635 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 30 12:59:14.588130 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.588109 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 30 12:59:14.588623 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.588601 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 30 12:59:14.589344 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.589323 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-f5n7z\"" Jul 30 12:59:14.590275 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.590253 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-f5b9b\"" Jul 30 12:59:14.611955 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.611928 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-tshxd" Jul 30 12:59:14.622898 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.622864 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-tshxd" Jul 30 12:59:14.670603 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.670573 2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 30 12:59:14.683073 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.683041 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077-ovn-node-metrics-cert\") pod \"ovnkube-node-zkflm\" (UID: \"e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-zkflm" Jul 30 12:59:14.683299 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.683080 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xh2jr\" (UniqueName: \"kubernetes.io/projected/4debd6c2-458e-46b6-9ac0-3aebd006c681-kube-api-access-xh2jr\") pod \"tuned-24667\" (UID: \"4debd6c2-458e-46b6-9ac0-3aebd006c681\") " pod="openshift-cluster-node-tuning-operator/tuned-24667" Jul 30 12:59:14.683299 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.683103 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5c1ccafd-7384-4569-b270-4b6083b23ca9-cni-binary-copy\") pod \"multus-additional-cni-plugins-228r4\" (UID: \"5c1ccafd-7384-4569-b270-4b6083b23ca9\") " pod="openshift-multus/multus-additional-cni-plugins-228r4" Jul 30 12:59:14.683299 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.683168 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0659b9a4-1828-4bd3-a1d9-b493d7fd6693-iptables-alerter-script\") pod \"iptables-alerter-rlk59\" (UID: \"0659b9a4-1828-4bd3-a1d9-b493d7fd6693\") " pod="openshift-network-operator/iptables-alerter-rlk59" Jul 30 12:59:14.683299 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.683185 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077-ovnkube-config\") pod \"ovnkube-node-zkflm\" (UID: \"e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-zkflm" Jul 30 12:59:14.683299 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.683206 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4debd6c2-458e-46b6-9ac0-3aebd006c681-tmp\") pod \"tuned-24667\" (UID: \"4debd6c2-458e-46b6-9ac0-3aebd006c681\") " pod="openshift-cluster-node-tuning-operator/tuned-24667" Jul 30 12:59:14.683299 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.683245 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5c1ccafd-7384-4569-b270-4b6083b23ca9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-228r4\" (UID: \"5c1ccafd-7384-4569-b270-4b6083b23ca9\") " pod="openshift-multus/multus-additional-cni-plugins-228r4" Jul 30 12:59:14.683299 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.683294 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077-run-ovn\") pod \"ovnkube-node-zkflm\" (UID: \"e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-zkflm" Jul 30 12:59:14.683662 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.683319 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2c2lf\" (UniqueName: \"kubernetes.io/projected/24802bd2-a87c-440d-8ce9-1ef4780224d4-kube-api-access-2c2lf\") pod \"network-check-target-8vppx\" (UID: \"24802bd2-a87c-440d-8ce9-1ef4780224d4\") " pod="openshift-network-diagnostics/network-check-target-8vppx" Jul 30 12:59:14.683662 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.683345 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ab45ff61-9eb3-4269-8007-d1e68fe130bc-sys-fs\") pod \"aws-ebs-csi-driver-node-nvcpn\" (UID: \"ab45ff61-9eb3-4269-8007-d1e68fe130bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nvcpn" Jul 30 12:59:14.683662 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.683367 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4debd6c2-458e-46b6-9ac0-3aebd006c681-etc-sysctl-conf\") pod \"tuned-24667\" (UID: \"4debd6c2-458e-46b6-9ac0-3aebd006c681\") " pod="openshift-cluster-node-tuning-operator/tuned-24667" Jul 30 12:59:14.683662 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.683391 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b-cni-binary-copy\") pod \"multus-5nn6b\" (UID: \"1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b\") " pod="openshift-multus/multus-5nn6b" Jul 30 12:59:14.683662 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.683435 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b-host-var-lib-kubelet\") pod \"multus-5nn6b\" (UID: \"1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b\") " pod="openshift-multus/multus-5nn6b" Jul 30 12:59:14.683662 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.683460 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ab45ff61-9eb3-4269-8007-d1e68fe130bc-etc-selinux\") pod \"aws-ebs-csi-driver-node-nvcpn\" (UID: \"ab45ff61-9eb3-4269-8007-d1e68fe130bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nvcpn" Jul 30 12:59:14.683662 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.683484 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4d9b0b7-6474-457f-b742-05d47589d56f-tmp-dir\") pod \"node-resolver-x7bbz\" (UID: \"a4d9b0b7-6474-457f-b742-05d47589d56f\") " pod="openshift-dns/node-resolver-x7bbz" Jul 30 12:59:14.683662 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.683519 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4467d9b-3531-4231-8fa2-278fec9b2f6d-metrics-certs\") pod \"network-metrics-daemon-mrfm9\" (UID: \"b4467d9b-3531-4231-8fa2-278fec9b2f6d\") " pod="openshift-multus/network-metrics-daemon-mrfm9" Jul 30 12:59:14.683662 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.683539 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8eca3445-f081-4f35-aa2c-603a2b80d815-host\") pod \"node-ca-9cpnl\" (UID: \"8eca3445-f081-4f35-aa2c-603a2b80d815\") " pod="openshift-image-registry/node-ca-9cpnl" Jul 30 12:59:14.683662 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.683554 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c1cb0fbf-c955-4c33-95fa-a70c1110aa3b-agent-certs\") pod \"konnectivity-agent-cbrzj\" (UID: \"c1cb0fbf-c955-4c33-95fa-a70c1110aa3b\") " pod="kube-system/konnectivity-agent-cbrzj" Jul 30 12:59:14.683662 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.683551 2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 30 12:59:14.683662 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.683570 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b-host-run-netns\") pod \"multus-5nn6b\" (UID: \"1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b\") " pod="openshift-multus/multus-5nn6b" Jul 30 12:59:14.683662 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.683624 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b-host-run-netns\") pod \"multus-5nn6b\" (UID: \"1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b\") " pod="openshift-multus/multus-5nn6b" Jul 30 12:59:14.684325 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.683675 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b-host-var-lib-kubelet\") pod \"multus-5nn6b\" (UID: \"1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b\") " pod="openshift-multus/multus-5nn6b" Jul 30 12:59:14.684325 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.683778 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ab45ff61-9eb3-4269-8007-d1e68fe130bc-etc-selinux\") pod \"aws-ebs-csi-driver-node-nvcpn\" (UID: \"ab45ff61-9eb3-4269-8007-d1e68fe130bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nvcpn" Jul 30 12:59:14.684325 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.683977 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0659b9a4-1828-4bd3-a1d9-b493d7fd6693-iptables-alerter-script\") pod \"iptables-alerter-rlk59\" (UID: \"0659b9a4-1828-4bd3-a1d9-b493d7fd6693\") " pod="openshift-network-operator/iptables-alerter-rlk59" Jul 30 12:59:14.684325 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.684056 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4d9b0b7-6474-457f-b742-05d47589d56f-tmp-dir\") pod \"node-resolver-x7bbz\" (UID: \"a4d9b0b7-6474-457f-b742-05d47589d56f\") " pod="openshift-dns/node-resolver-x7bbz" Jul 30 12:59:14.684325 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.684150 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b-cni-binary-copy\") pod \"multus-5nn6b\" (UID: \"1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b\") " pod="openshift-multus/multus-5nn6b" Jul 30 12:59:14.684325 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.684168 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077-run-ovn\") pod \"ovnkube-node-zkflm\" (UID: \"e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-zkflm" Jul 30 12:59:14.684325 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.684219 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ab45ff61-9eb3-4269-8007-d1e68fe130bc-sys-fs\") pod \"aws-ebs-csi-driver-node-nvcpn\" (UID: \"ab45ff61-9eb3-4269-8007-d1e68fe130bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nvcpn" Jul 30 12:59:14.684325 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.684312 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4debd6c2-458e-46b6-9ac0-3aebd006c681-etc-sysctl-conf\") pod \"tuned-24667\" (UID: \"4debd6c2-458e-46b6-9ac0-3aebd006c681\") " pod="openshift-cluster-node-tuning-operator/tuned-24667" Jul 30 12:59:14.684728 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.684315 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077-host-kubelet\") pod \"ovnkube-node-zkflm\" (UID: \"e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-zkflm" Jul 30 12:59:14.684728 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.684345 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077-host-kubelet\") pod \"ovnkube-node-zkflm\" (UID: \"e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-zkflm" Jul 30 12:59:14.684728 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.684364 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077-log-socket\") pod \"ovnkube-node-zkflm\" (UID: \"e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-zkflm" Jul 30 12:59:14.684728 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.684391 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077-ovnkube-script-lib\") pod \"ovnkube-node-zkflm\" (UID: \"e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-zkflm" Jul 30 12:59:14.684728 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.684438 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ab45ff61-9eb3-4269-8007-d1e68fe130bc-socket-dir\") pod \"aws-ebs-csi-driver-node-nvcpn\" (UID: \"ab45ff61-9eb3-4269-8007-d1e68fe130bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nvcpn" Jul 30 12:59:14.684728 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.684463 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4debd6c2-458e-46b6-9ac0-3aebd006c681-etc-systemd\") pod \"tuned-24667\" (UID: \"4debd6c2-458e-46b6-9ac0-3aebd006c681\") " pod="openshift-cluster-node-tuning-operator/tuned-24667" Jul 30 12:59:14.684728 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.684473 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077-log-socket\") pod \"ovnkube-node-zkflm\" (UID: \"e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-zkflm" Jul 30 12:59:14.684728 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.684491 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5c1ccafd-7384-4569-b270-4b6083b23ca9-system-cni-dir\") pod \"multus-additional-cni-plugins-228r4\" (UID: \"5c1ccafd-7384-4569-b270-4b6083b23ca9\") " pod="openshift-multus/multus-additional-cni-plugins-228r4" Jul 30 12:59:14.684728 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.684516 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077-ovnkube-config\") pod \"ovnkube-node-zkflm\" (UID: \"e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-zkflm" Jul 30 12:59:14.684728 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.684519 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5c1ccafd-7384-4569-b270-4b6083b23ca9-os-release\") pod \"multus-additional-cni-plugins-228r4\" (UID: \"5c1ccafd-7384-4569-b270-4b6083b23ca9\") " pod="openshift-multus/multus-additional-cni-plugins-228r4" Jul 30 12:59:14.684728 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.684575 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b-multus-conf-dir\") pod \"multus-5nn6b\" (UID: \"1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b\") " pod="openshift-multus/multus-5nn6b" Jul 30 12:59:14.684728 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.684602 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077-host-cni-bin\") pod \"ovnkube-node-zkflm\" (UID: \"e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-zkflm" Jul 30 12:59:14.684728 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.684609 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b-multus-conf-dir\") pod \"multus-5nn6b\" (UID: \"1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b\") " pod="openshift-multus/multus-5nn6b" Jul 30 12:59:14.684728 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.684625 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4debd6c2-458e-46b6-9ac0-3aebd006c681-host\") pod \"tuned-24667\" (UID: \"4debd6c2-458e-46b6-9ac0-3aebd006c681\") " pod="openshift-cluster-node-tuning-operator/tuned-24667" Jul 30 12:59:14.684728 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.684651 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077-host-cni-bin\") pod \"ovnkube-node-zkflm\" (UID: \"e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-zkflm" Jul 30 12:59:14.684728 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.684577 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4debd6c2-458e-46b6-9ac0-3aebd006c681-etc-systemd\") pod \"tuned-24667\" (UID: \"4debd6c2-458e-46b6-9ac0-3aebd006c681\") " pod="openshift-cluster-node-tuning-operator/tuned-24667" Jul 30 12:59:14.684728 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.684575 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ab45ff61-9eb3-4269-8007-d1e68fe130bc-socket-dir\") pod \"aws-ebs-csi-driver-node-nvcpn\" (UID: \"ab45ff61-9eb3-4269-8007-d1e68fe130bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nvcpn" Jul 30 12:59:14.685669 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.684678 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6zll\" (UniqueName: \"kubernetes.io/projected/a4d9b0b7-6474-457f-b742-05d47589d56f-kube-api-access-v6zll\") pod \"node-resolver-x7bbz\" (UID: \"a4d9b0b7-6474-457f-b742-05d47589d56f\") " pod="openshift-dns/node-resolver-x7bbz" Jul 30 12:59:14.685669 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.684705 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5c1ccafd-7384-4569-b270-4b6083b23ca9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-228r4\" (UID: \"5c1ccafd-7384-4569-b270-4b6083b23ca9\") " pod="openshift-multus/multus-additional-cni-plugins-228r4" Jul 30 12:59:14.685669 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.684711 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4debd6c2-458e-46b6-9ac0-3aebd006c681-host\") pod \"tuned-24667\" (UID: \"4debd6c2-458e-46b6-9ac0-3aebd006c681\") " pod="openshift-cluster-node-tuning-operator/tuned-24667" Jul 30 12:59:14.685669 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.684728 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077-run-systemd\") pod \"ovnkube-node-zkflm\" (UID: \"e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-zkflm" Jul 30 12:59:14.685669 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.684749 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4debd6c2-458e-46b6-9ac0-3aebd006c681-etc-kubernetes\") pod \"tuned-24667\" (UID: \"4debd6c2-458e-46b6-9ac0-3aebd006c681\") " pod="openshift-cluster-node-tuning-operator/tuned-24667" Jul 30 12:59:14.685669 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.684768 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4debd6c2-458e-46b6-9ac0-3aebd006c681-etc-sysctl-d\") pod \"tuned-24667\" (UID: \"4debd6c2-458e-46b6-9ac0-3aebd006c681\") " pod="openshift-cluster-node-tuning-operator/tuned-24667" Jul 30 12:59:14.685669 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.684788 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b-cnibin\") pod \"multus-5nn6b\" (UID: \"1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b\") " pod="openshift-multus/multus-5nn6b" Jul 30 12:59:14.685669 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.684807 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077-host-run-netns\") pod \"ovnkube-node-zkflm\" (UID: \"e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-zkflm" Jul 30 12:59:14.685669 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.684826 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077-host-cni-netd\") pod \"ovnkube-node-zkflm\" (UID: \"e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-zkflm" Jul 30 12:59:14.685669 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.684847 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4debd6c2-458e-46b6-9ac0-3aebd006c681-etc-modprobe-d\") pod \"tuned-24667\" (UID: \"4debd6c2-458e-46b6-9ac0-3aebd006c681\") " pod="openshift-cluster-node-tuning-operator/tuned-24667" Jul 30 12:59:14.685669 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.684865 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a4d9b0b7-6474-457f-b742-05d47589d56f-hosts-file\") pod \"node-resolver-x7bbz\" (UID: \"a4d9b0b7-6474-457f-b742-05d47589d56f\") " pod="openshift-dns/node-resolver-x7bbz" Jul 30 12:59:14.685669 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.684884 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b-hostroot\") pod \"multus-5nn6b\" (UID: \"1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b\") " pod="openshift-multus/multus-5nn6b" Jul 30 12:59:14.685669 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.684918 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077-run-openvswitch\") pod \"ovnkube-node-zkflm\" (UID: \"e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-zkflm" Jul 30 12:59:14.685669 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.684940 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zkflm\" (UID: \"e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-zkflm" Jul 30 12:59:14.685669 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.684982 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077-host-run-netns\") pod \"ovnkube-node-zkflm\" (UID: \"e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-zkflm" Jul 30 12:59:14.685669 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.684990 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4n2kd\" (UniqueName: \"kubernetes.io/projected/b4467d9b-3531-4231-8fa2-278fec9b2f6d-kube-api-access-4n2kd\") pod \"network-metrics-daemon-mrfm9\" (UID: \"b4467d9b-3531-4231-8fa2-278fec9b2f6d\") " pod="openshift-multus/network-metrics-daemon-mrfm9" Jul 30 12:59:14.685669 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.684985 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077-ovnkube-script-lib\") pod \"ovnkube-node-zkflm\" (UID: \"e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-zkflm" Jul 30 12:59:14.686497 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.685013 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c1cb0fbf-c955-4c33-95fa-a70c1110aa3b-konnectivity-ca\") pod \"konnectivity-agent-cbrzj\" (UID: \"c1cb0fbf-c955-4c33-95fa-a70c1110aa3b\") " pod="kube-system/konnectivity-agent-cbrzj" Jul 30 12:59:14.686497 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.685049 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077-run-systemd\") pod \"ovnkube-node-zkflm\" (UID: \"e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-zkflm" Jul 30 12:59:14.686497 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.685073 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077-host-cni-netd\") pod \"ovnkube-node-zkflm\" (UID: \"e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-zkflm" Jul 30 12:59:14.686497 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.685080 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b-hostroot\") pod \"multus-5nn6b\" (UID: \"1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b\") " pod="openshift-multus/multus-5nn6b" Jul 30 12:59:14.686497 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.685150 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a4d9b0b7-6474-457f-b742-05d47589d56f-hosts-file\") pod \"node-resolver-x7bbz\" (UID: \"a4d9b0b7-6474-457f-b742-05d47589d56f\") " pod="openshift-dns/node-resolver-x7bbz" Jul 30 12:59:14.686497 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.685183 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077-run-openvswitch\") pod \"ovnkube-node-zkflm\" (UID: \"e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-zkflm" Jul 30 12:59:14.686497 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.685211 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4debd6c2-458e-46b6-9ac0-3aebd006c681-etc-sysctl-d\") pod \"tuned-24667\" (UID: \"4debd6c2-458e-46b6-9ac0-3aebd006c681\") " pod="openshift-cluster-node-tuning-operator/tuned-24667" Jul 30 12:59:14.686497 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.685255 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4debd6c2-458e-46b6-9ac0-3aebd006c681-etc-modprobe-d\") pod \"tuned-24667\" (UID: \"4debd6c2-458e-46b6-9ac0-3aebd006c681\") " pod="openshift-cluster-node-tuning-operator/tuned-24667" Jul 30 12:59:14.686497 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.685254 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4debd6c2-458e-46b6-9ac0-3aebd006c681-etc-kubernetes\") pod \"tuned-24667\" (UID: \"4debd6c2-458e-46b6-9ac0-3aebd006c681\") " pod="openshift-cluster-node-tuning-operator/tuned-24667" Jul 30 12:59:14.686497 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.685087 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077-env-overrides\") pod \"ovnkube-node-zkflm\" (UID: \"e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-zkflm" Jul 30 12:59:14.686497 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.685291 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ab45ff61-9eb3-4269-8007-d1e68fe130bc-registration-dir\") pod \"aws-ebs-csi-driver-node-nvcpn\" (UID: \"ab45ff61-9eb3-4269-8007-d1e68fe130bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nvcpn" Jul 30 12:59:14.686497 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.685305 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b-cnibin\") pod \"multus-5nn6b\" (UID: \"1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b\") " pod="openshift-multus/multus-5nn6b" Jul 30 12:59:14.686497 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.685315 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4debd6c2-458e-46b6-9ac0-3aebd006c681-run\") pod \"tuned-24667\" (UID: \"4debd6c2-458e-46b6-9ac0-3aebd006c681\") " pod="openshift-cluster-node-tuning-operator/tuned-24667" Jul 30 12:59:14.686497 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.685338 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4debd6c2-458e-46b6-9ac0-3aebd006c681-sys\") pod \"tuned-24667\" (UID: \"4debd6c2-458e-46b6-9ac0-3aebd006c681\") " pod="openshift-cluster-node-tuning-operator/tuned-24667" Jul 30 12:59:14.686497 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.685355 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zkflm\" (UID: \"e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-zkflm" Jul 30 12:59:14.686497 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.685361 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e4027c79-c8b8-4800-9db1-843170f52290-original-pull-secret\") pod \"global-pull-secret-syncer-xzq9h\" (UID: \"e4027c79-c8b8-4800-9db1-843170f52290\") " pod="kube-system/global-pull-secret-syncer-xzq9h" Jul 30 12:59:14.686497 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.685393 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ab45ff61-9eb3-4269-8007-d1e68fe130bc-registration-dir\") pod \"aws-ebs-csi-driver-node-nvcpn\" (UID: \"ab45ff61-9eb3-4269-8007-d1e68fe130bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nvcpn" Jul 30 12:59:14.686497 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.685401 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4debd6c2-458e-46b6-9ac0-3aebd006c681-sys\") pod \"tuned-24667\" (UID: \"4debd6c2-458e-46b6-9ac0-3aebd006c681\") " pod="openshift-cluster-node-tuning-operator/tuned-24667" Jul 30 12:59:14.687394 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.685439 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077-node-log\") pod \"ovnkube-node-zkflm\" (UID: \"e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-zkflm" Jul 30 12:59:14.687394 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.685443 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077-env-overrides\") pod \"ovnkube-node-zkflm\" (UID: \"e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-zkflm" Jul 30 12:59:14.687394 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.685462 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ab45ff61-9eb3-4269-8007-d1e68fe130bc-device-dir\") pod \"aws-ebs-csi-driver-node-nvcpn\" (UID: \"ab45ff61-9eb3-4269-8007-d1e68fe130bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nvcpn" Jul 30 12:59:14.687394 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.685470 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4debd6c2-458e-46b6-9ac0-3aebd006c681-run\") pod \"tuned-24667\" (UID: \"4debd6c2-458e-46b6-9ac0-3aebd006c681\") " pod="openshift-cluster-node-tuning-operator/tuned-24667" Jul 30 12:59:14.687394 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.685467 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077-node-log\") pod \"ovnkube-node-zkflm\" (UID: \"e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-zkflm" Jul 30 12:59:14.687394 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.685488 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e4027c79-c8b8-4800-9db1-843170f52290-kubelet-config\") pod \"global-pull-secret-syncer-xzq9h\" (UID: \"e4027c79-c8b8-4800-9db1-843170f52290\") " pod="kube-system/global-pull-secret-syncer-xzq9h" Jul 30 12:59:14.687394 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.685509 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8eca3445-f081-4f35-aa2c-603a2b80d815-serviceca\") pod \"node-ca-9cpnl\" (UID: \"8eca3445-f081-4f35-aa2c-603a2b80d815\") " pod="openshift-image-registry/node-ca-9cpnl" Jul 30 12:59:14.687394 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.685532 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5c1ccafd-7384-4569-b270-4b6083b23ca9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-228r4\" (UID: \"5c1ccafd-7384-4569-b270-4b6083b23ca9\") " pod="openshift-multus/multus-additional-cni-plugins-228r4" Jul 30 12:59:14.687394 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.685555 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b-os-release\") pod \"multus-5nn6b\" (UID: \"1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b\") " pod="openshift-multus/multus-5nn6b" Jul 30 12:59:14.687394 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.685508 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ab45ff61-9eb3-4269-8007-d1e68fe130bc-device-dir\") pod \"aws-ebs-csi-driver-node-nvcpn\" (UID: \"ab45ff61-9eb3-4269-8007-d1e68fe130bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nvcpn" Jul 30 12:59:14.687394 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.685581 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b-multus-socket-dir-parent\") pod \"multus-5nn6b\" (UID: \"1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b\") " pod="openshift-multus/multus-5nn6b" Jul 30 12:59:14.687394 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.685628 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dg54k\" (UniqueName: \"kubernetes.io/projected/1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b-kube-api-access-dg54k\") pod \"multus-5nn6b\" (UID: \"1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b\") " pod="openshift-multus/multus-5nn6b" Jul 30 12:59:14.687394 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.685696 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077-host-run-ovn-kubernetes\") pod \"ovnkube-node-zkflm\" (UID: \"e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-zkflm" Jul 30 12:59:14.687394 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.685705 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b-multus-socket-dir-parent\") pod \"multus-5nn6b\" (UID: \"1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b\") " pod="openshift-multus/multus-5nn6b" Jul 30 12:59:14.687394 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.685744 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077-host-run-ovn-kubernetes\") pod \"ovnkube-node-zkflm\" (UID: \"e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-zkflm" Jul 30 12:59:14.687394 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.685759 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b-os-release\") pod \"multus-5nn6b\" (UID: \"1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b\") " pod="openshift-multus/multus-5nn6b" Jul 30 12:59:14.687394 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.685779 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmqpw\" (UniqueName: \"kubernetes.io/projected/ab45ff61-9eb3-4269-8007-d1e68fe130bc-kube-api-access-kmqpw\") pod \"aws-ebs-csi-driver-node-nvcpn\" (UID: \"ab45ff61-9eb3-4269-8007-d1e68fe130bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nvcpn" Jul 30 12:59:14.688266 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.685821 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b-system-cni-dir\") pod \"multus-5nn6b\" (UID: \"1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b\") " pod="openshift-multus/multus-5nn6b" Jul 30 12:59:14.688266 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.685864 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b-host-var-lib-cni-multus\") pod \"multus-5nn6b\" (UID: \"1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b\") " pod="openshift-multus/multus-5nn6b" Jul 30 12:59:14.688266 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.685889 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077-etc-openvswitch\") pod \"ovnkube-node-zkflm\" (UID: \"e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-zkflm" Jul 30 12:59:14.688266 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.685924 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ab45ff61-9eb3-4269-8007-d1e68fe130bc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nvcpn\" (UID: \"ab45ff61-9eb3-4269-8007-d1e68fe130bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nvcpn" Jul 30 12:59:14.688266 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.685948 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4debd6c2-458e-46b6-9ac0-3aebd006c681-lib-modules\") pod \"tuned-24667\" (UID: \"4debd6c2-458e-46b6-9ac0-3aebd006c681\") " pod="openshift-cluster-node-tuning-operator/tuned-24667" Jul 30 12:59:14.688266 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.685976 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxbdd\" (UniqueName: \"kubernetes.io/projected/8eca3445-f081-4f35-aa2c-603a2b80d815-kube-api-access-dxbdd\") pod \"node-ca-9cpnl\" (UID: \"8eca3445-f081-4f35-aa2c-603a2b80d815\") " pod="openshift-image-registry/node-ca-9cpnl" Jul 30 12:59:14.688266 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.686002 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5c1ccafd-7384-4569-b270-4b6083b23ca9-cnibin\") pod \"multus-additional-cni-plugins-228r4\" (UID: \"5c1ccafd-7384-4569-b270-4b6083b23ca9\") " pod="openshift-multus/multus-additional-cni-plugins-228r4" Jul 30 12:59:14.688266 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.686029 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077-etc-openvswitch\") pod \"ovnkube-node-zkflm\" (UID: \"e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-zkflm" Jul 30 12:59:14.688266 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.686026 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0659b9a4-1828-4bd3-a1d9-b493d7fd6693-host-slash\") pod \"iptables-alerter-rlk59\" (UID: \"0659b9a4-1828-4bd3-a1d9-b493d7fd6693\") " pod="openshift-network-operator/iptables-alerter-rlk59" Jul 30 12:59:14.688266 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.686082 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0659b9a4-1828-4bd3-a1d9-b493d7fd6693-host-slash\") pod \"iptables-alerter-rlk59\" (UID: \"0659b9a4-1828-4bd3-a1d9-b493d7fd6693\") " pod="openshift-network-operator/iptables-alerter-rlk59" Jul 30 12:59:14.688266 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.686084 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b-system-cni-dir\") pod \"multus-5nn6b\" (UID: \"1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b\") " pod="openshift-multus/multus-5nn6b" Jul 30 12:59:14.688266 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.686106 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2g8f7\" (UniqueName: \"kubernetes.io/projected/0659b9a4-1828-4bd3-a1d9-b493d7fd6693-kube-api-access-2g8f7\") pod \"iptables-alerter-rlk59\" (UID: \"0659b9a4-1828-4bd3-a1d9-b493d7fd6693\") " pod="openshift-network-operator/iptables-alerter-rlk59" Jul 30 12:59:14.688266 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.686140 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b-host-var-lib-cni-bin\") pod \"multus-5nn6b\" (UID: \"1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b\") " pod="openshift-multus/multus-5nn6b" Jul 30 12:59:14.688266 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.686198 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4debd6c2-458e-46b6-9ac0-3aebd006c681-lib-modules\") pod \"tuned-24667\" (UID: \"4debd6c2-458e-46b6-9ac0-3aebd006c681\") " pod="openshift-cluster-node-tuning-operator/tuned-24667" Jul 30 12:59:14.688266 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.686279 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077-var-lib-openvswitch\") pod \"ovnkube-node-zkflm\" (UID: \"e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-zkflm" Jul 30 12:59:14.688266 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.686315 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4debd6c2-458e-46b6-9ac0-3aebd006c681-etc-sysconfig\") pod \"tuned-24667\" (UID: \"4debd6c2-458e-46b6-9ac0-3aebd006c681\") " pod="openshift-cluster-node-tuning-operator/tuned-24667" Jul 30 12:59:14.688266 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.686325 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b-host-var-lib-cni-bin\") pod \"multus-5nn6b\" (UID: \"1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b\") " pod="openshift-multus/multus-5nn6b" Jul 30 12:59:14.689185 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.686343 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077-var-lib-openvswitch\") pod \"ovnkube-node-zkflm\" (UID: \"e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-zkflm" Jul 30 12:59:14.689185 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.686361 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ab45ff61-9eb3-4269-8007-d1e68fe130bc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nvcpn\" (UID: \"ab45ff61-9eb3-4269-8007-d1e68fe130bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nvcpn" Jul 30 12:59:14.689185 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.686391 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4debd6c2-458e-46b6-9ac0-3aebd006c681-etc-tuned\") pod \"tuned-24667\" (UID: \"4debd6c2-458e-46b6-9ac0-3aebd006c681\") " pod="openshift-cluster-node-tuning-operator/tuned-24667" Jul 30 12:59:14.689185 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.686425 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4debd6c2-458e-46b6-9ac0-3aebd006c681-etc-sysconfig\") pod \"tuned-24667\" (UID: \"4debd6c2-458e-46b6-9ac0-3aebd006c681\") " pod="openshift-cluster-node-tuning-operator/tuned-24667" Jul 30 12:59:14.689185 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.686431 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e4027c79-c8b8-4800-9db1-843170f52290-dbus\") pod \"global-pull-secret-syncer-xzq9h\" (UID: \"e4027c79-c8b8-4800-9db1-843170f52290\") " pod="kube-system/global-pull-secret-syncer-xzq9h" Jul 30 12:59:14.689185 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.686465 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-967kr\" (UniqueName: \"kubernetes.io/projected/5c1ccafd-7384-4569-b270-4b6083b23ca9-kube-api-access-967kr\") pod \"multus-additional-cni-plugins-228r4\" (UID: \"5c1ccafd-7384-4569-b270-4b6083b23ca9\") " pod="openshift-multus/multus-additional-cni-plugins-228r4" Jul 30 12:59:14.689185 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.686478 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b-host-var-lib-cni-multus\") pod \"multus-5nn6b\" (UID: \"1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b\") " pod="openshift-multus/multus-5nn6b" Jul 30 12:59:14.689185 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.686491 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077-systemd-units\") pod \"ovnkube-node-zkflm\" (UID: \"e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-zkflm" Jul 30 12:59:14.689185 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.686609 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077-systemd-units\") pod \"ovnkube-node-zkflm\" (UID: \"e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-zkflm" Jul 30 12:59:14.689185 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.686640 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077-host-slash\") pod \"ovnkube-node-zkflm\" (UID: \"e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-zkflm" Jul 30 12:59:14.689185 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.686676 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b-multus-cni-dir\") pod \"multus-5nn6b\" (UID: \"1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b\") " pod="openshift-multus/multus-5nn6b" Jul 30 12:59:14.689185 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.686700 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b-host-run-k8s-cni-cncf-io\") pod \"multus-5nn6b\" (UID: \"1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b\") " pod="openshift-multus/multus-5nn6b" Jul 30 12:59:14.689185 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.686750 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b-host-run-k8s-cni-cncf-io\") pod \"multus-5nn6b\" (UID: \"1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b\") " pod="openshift-multus/multus-5nn6b" Jul 30 12:59:14.689185 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.686779 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b-multus-cni-dir\") pod \"multus-5nn6b\" (UID: \"1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b\") " pod="openshift-multus/multus-5nn6b" Jul 30 12:59:14.689185 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.686788 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077-host-slash\") pod \"ovnkube-node-zkflm\" (UID: \"e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-zkflm" Jul 30 12:59:14.689185 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.686820 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b-multus-daemon-config\") pod \"multus-5nn6b\" (UID: \"1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b\") " pod="openshift-multus/multus-5nn6b" Jul 30 12:59:14.689185 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.686868 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnbjj\" (UniqueName: \"kubernetes.io/projected/e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077-kube-api-access-vnbjj\") pod \"ovnkube-node-zkflm\" (UID: \"e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-zkflm" Jul 30 12:59:14.690111 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.686893 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4debd6c2-458e-46b6-9ac0-3aebd006c681-var-lib-kubelet\") pod \"tuned-24667\" (UID: \"4debd6c2-458e-46b6-9ac0-3aebd006c681\") " pod="openshift-cluster-node-tuning-operator/tuned-24667" Jul 30 12:59:14.690111 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.686915 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b-host-run-multus-certs\") pod \"multus-5nn6b\" (UID: \"1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b\") " pod="openshift-multus/multus-5nn6b" Jul 30 12:59:14.690111 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.686938 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b-etc-kubernetes\") pod \"multus-5nn6b\" (UID: \"1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b\") " pod="openshift-multus/multus-5nn6b" Jul 30 12:59:14.690111 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.687009 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b-etc-kubernetes\") pod \"multus-5nn6b\" (UID: \"1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b\") " pod="openshift-multus/multus-5nn6b" Jul 30 12:59:14.690111 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.687059 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4debd6c2-458e-46b6-9ac0-3aebd006c681-var-lib-kubelet\") pod \"tuned-24667\" (UID: \"4debd6c2-458e-46b6-9ac0-3aebd006c681\") " pod="openshift-cluster-node-tuning-operator/tuned-24667" Jul 30 12:59:14.690111 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.687111 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b-host-run-multus-certs\") pod \"multus-5nn6b\" (UID: \"1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b\") " pod="openshift-multus/multus-5nn6b" Jul 30 12:59:14.690111 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.687299 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b-multus-daemon-config\") pod \"multus-5nn6b\" (UID: \"1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b\") " pod="openshift-multus/multus-5nn6b" Jul 30 12:59:14.690111 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.687830 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4debd6c2-458e-46b6-9ac0-3aebd006c681-tmp\") pod \"tuned-24667\" (UID: \"4debd6c2-458e-46b6-9ac0-3aebd006c681\") " pod="openshift-cluster-node-tuning-operator/tuned-24667" Jul 30 12:59:14.690111 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.687878 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077-ovn-node-metrics-cert\") pod \"ovnkube-node-zkflm\" (UID: \"e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-zkflm" Jul 30 12:59:14.690111 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.689437 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4debd6c2-458e-46b6-9ac0-3aebd006c681-etc-tuned\") pod \"tuned-24667\" (UID: \"4debd6c2-458e-46b6-9ac0-3aebd006c681\") " pod="openshift-cluster-node-tuning-operator/tuned-24667" Jul 30 12:59:14.693901 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:14.693562 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 30 12:59:14.693901 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:14.693586 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 30 12:59:14.693901 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:14.693616 2579 projected.go:196] Error preparing data for projected volume kube-api-access-2c2lf for pod openshift-network-diagnostics/network-check-target-8vppx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 30 12:59:14.693901 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:14.693724 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/24802bd2-a87c-440d-8ce9-1ef4780224d4-kube-api-access-2c2lf podName:24802bd2-a87c-440d-8ce9-1ef4780224d4 nodeName:}" failed. No retries permitted until 2026-07-30 12:59:15.193702697 +0000 UTC m=+3.025168806 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2c2lf" (UniqueName: "kubernetes.io/projected/24802bd2-a87c-440d-8ce9-1ef4780224d4-kube-api-access-2c2lf") pod "network-check-target-8vppx" (UID: "24802bd2-a87c-440d-8ce9-1ef4780224d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 30 12:59:14.694249 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.694037 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xh2jr\" (UniqueName: \"kubernetes.io/projected/4debd6c2-458e-46b6-9ac0-3aebd006c681-kube-api-access-xh2jr\") pod \"tuned-24667\" (UID: \"4debd6c2-458e-46b6-9ac0-3aebd006c681\") " pod="openshift-cluster-node-tuning-operator/tuned-24667" Jul 30 12:59:14.696082 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.696011 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dg54k\" (UniqueName: \"kubernetes.io/projected/1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b-kube-api-access-dg54k\") pod \"multus-5nn6b\" (UID: \"1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b\") " pod="openshift-multus/multus-5nn6b" Jul 30 12:59:14.696251 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.696230 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6zll\" (UniqueName: \"kubernetes.io/projected/a4d9b0b7-6474-457f-b742-05d47589d56f-kube-api-access-v6zll\") pod \"node-resolver-x7bbz\" (UID: \"a4d9b0b7-6474-457f-b742-05d47589d56f\") " pod="openshift-dns/node-resolver-x7bbz" Jul 30 12:59:14.705782 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.705719 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-230.ec2.internal" event={"ID":"66d7deccf1aa4e927a9cf89772adac78","Type":"ContainerStarted","Data":"644485e0e3f83ce0db0d4ac292baf67b3f0c0e5493aba0b584b6286a72524b59"} Jul 30 12:59:14.707075 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.707014 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-230.ec2.internal" event={"ID":"b39ac35dac0bf47dea91e3680de30c40","Type":"ContainerStarted","Data":"fe58b38b6363022af700f091607b02843c86a329e58307048baaf3121075417a"} Jul 30 12:59:14.708536 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.708210 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2g8f7\" (UniqueName: \"kubernetes.io/projected/0659b9a4-1828-4bd3-a1d9-b493d7fd6693-kube-api-access-2g8f7\") pod \"iptables-alerter-rlk59\" (UID: \"0659b9a4-1828-4bd3-a1d9-b493d7fd6693\") " pod="openshift-network-operator/iptables-alerter-rlk59" Jul 30 12:59:14.709982 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.709959 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnbjj\" (UniqueName: \"kubernetes.io/projected/e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077-kube-api-access-vnbjj\") pod \"ovnkube-node-zkflm\" (UID: \"e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-zkflm" Jul 30 12:59:14.714302 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.714281 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmqpw\" (UniqueName: \"kubernetes.io/projected/ab45ff61-9eb3-4269-8007-d1e68fe130bc-kube-api-access-kmqpw\") pod \"aws-ebs-csi-driver-node-nvcpn\" (UID: \"ab45ff61-9eb3-4269-8007-d1e68fe130bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nvcpn" Jul 30 12:59:14.788282 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.788243 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e4027c79-c8b8-4800-9db1-843170f52290-original-pull-secret\") pod \"global-pull-secret-syncer-xzq9h\" (UID: \"e4027c79-c8b8-4800-9db1-843170f52290\") " pod="kube-system/global-pull-secret-syncer-xzq9h" Jul 30 12:59:14.788282 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.788277 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e4027c79-c8b8-4800-9db1-843170f52290-kubelet-config\") pod \"global-pull-secret-syncer-xzq9h\" (UID: \"e4027c79-c8b8-4800-9db1-843170f52290\") " pod="kube-system/global-pull-secret-syncer-xzq9h" Jul 30 12:59:14.788545 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.788296 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8eca3445-f081-4f35-aa2c-603a2b80d815-serviceca\") pod \"node-ca-9cpnl\" (UID: \"8eca3445-f081-4f35-aa2c-603a2b80d815\") " pod="openshift-image-registry/node-ca-9cpnl" Jul 30 12:59:14.788545 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.788319 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5c1ccafd-7384-4569-b270-4b6083b23ca9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-228r4\" (UID: \"5c1ccafd-7384-4569-b270-4b6083b23ca9\") " pod="openshift-multus/multus-additional-cni-plugins-228r4" Jul 30 12:59:14.788545 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.788369 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxbdd\" (UniqueName: \"kubernetes.io/projected/8eca3445-f081-4f35-aa2c-603a2b80d815-kube-api-access-dxbdd\") pod \"node-ca-9cpnl\" (UID: \"8eca3445-f081-4f35-aa2c-603a2b80d815\") " pod="openshift-image-registry/node-ca-9cpnl" Jul 30 12:59:14.788545 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:14.788400 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 30 12:59:14.788545 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.788403 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5c1ccafd-7384-4569-b270-4b6083b23ca9-cnibin\") pod \"multus-additional-cni-plugins-228r4\" (UID: \"5c1ccafd-7384-4569-b270-4b6083b23ca9\") " pod="openshift-multus/multus-additional-cni-plugins-228r4" Jul 30 12:59:14.788545 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.788401 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e4027c79-c8b8-4800-9db1-843170f52290-kubelet-config\") pod \"global-pull-secret-syncer-xzq9h\" (UID: \"e4027c79-c8b8-4800-9db1-843170f52290\") " pod="kube-system/global-pull-secret-syncer-xzq9h" Jul 30 12:59:14.788545 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.788456 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e4027c79-c8b8-4800-9db1-843170f52290-dbus\") pod \"global-pull-secret-syncer-xzq9h\" (UID: \"e4027c79-c8b8-4800-9db1-843170f52290\") " pod="kube-system/global-pull-secret-syncer-xzq9h" Jul 30 12:59:14.788545 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.788496 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-967kr\" (UniqueName: \"kubernetes.io/projected/5c1ccafd-7384-4569-b270-4b6083b23ca9-kube-api-access-967kr\") pod \"multus-additional-cni-plugins-228r4\" (UID: \"5c1ccafd-7384-4569-b270-4b6083b23ca9\") " pod="openshift-multus/multus-additional-cni-plugins-228r4" Jul 30 12:59:14.788545 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:14.788505 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4027c79-c8b8-4800-9db1-843170f52290-original-pull-secret podName:e4027c79-c8b8-4800-9db1-843170f52290 nodeName:}" failed. No retries permitted until 2026-07-30 12:59:15.288477674 +0000 UTC m=+3.119943799 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e4027c79-c8b8-4800-9db1-843170f52290-original-pull-secret") pod "global-pull-secret-syncer-xzq9h" (UID: "e4027c79-c8b8-4800-9db1-843170f52290") : object "kube-system"/"original-pull-secret" not registered Jul 30 12:59:14.788545 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.788542 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5c1ccafd-7384-4569-b270-4b6083b23ca9-cni-binary-copy\") pod \"multus-additional-cni-plugins-228r4\" (UID: \"5c1ccafd-7384-4569-b270-4b6083b23ca9\") " pod="openshift-multus/multus-additional-cni-plugins-228r4" Jul 30 12:59:14.789018 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.788572 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5c1ccafd-7384-4569-b270-4b6083b23ca9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-228r4\" (UID: \"5c1ccafd-7384-4569-b270-4b6083b23ca9\") " pod="openshift-multus/multus-additional-cni-plugins-228r4" Jul 30 12:59:14.789018 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.788613 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4467d9b-3531-4231-8fa2-278fec9b2f6d-metrics-certs\") pod \"network-metrics-daemon-mrfm9\" (UID: \"b4467d9b-3531-4231-8fa2-278fec9b2f6d\") " pod="openshift-multus/network-metrics-daemon-mrfm9" Jul 30 12:59:14.789018 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.788630 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5c1ccafd-7384-4569-b270-4b6083b23ca9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-228r4\" (UID: \"5c1ccafd-7384-4569-b270-4b6083b23ca9\") " pod="openshift-multus/multus-additional-cni-plugins-228r4" Jul 30 12:59:14.789018 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.788636 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8eca3445-f081-4f35-aa2c-603a2b80d815-host\") pod \"node-ca-9cpnl\" (UID: \"8eca3445-f081-4f35-aa2c-603a2b80d815\") " pod="openshift-image-registry/node-ca-9cpnl" Jul 30 12:59:14.789018 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.788671 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8eca3445-f081-4f35-aa2c-603a2b80d815-host\") pod \"node-ca-9cpnl\" (UID: \"8eca3445-f081-4f35-aa2c-603a2b80d815\") " pod="openshift-image-registry/node-ca-9cpnl" Jul 30 12:59:14.789018 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.788690 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c1cb0fbf-c955-4c33-95fa-a70c1110aa3b-agent-certs\") pod \"konnectivity-agent-cbrzj\" (UID: \"c1cb0fbf-c955-4c33-95fa-a70c1110aa3b\") " pod="kube-system/konnectivity-agent-cbrzj" Jul 30 12:59:14.789018 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.788729 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5c1ccafd-7384-4569-b270-4b6083b23ca9-system-cni-dir\") pod \"multus-additional-cni-plugins-228r4\" (UID: \"5c1ccafd-7384-4569-b270-4b6083b23ca9\") " pod="openshift-multus/multus-additional-cni-plugins-228r4" Jul 30 12:59:14.789018 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.788753 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5c1ccafd-7384-4569-b270-4b6083b23ca9-os-release\") pod \"multus-additional-cni-plugins-228r4\" (UID: \"5c1ccafd-7384-4569-b270-4b6083b23ca9\") " pod="openshift-multus/multus-additional-cni-plugins-228r4" Jul 30 12:59:14.789018 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.788827 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5c1ccafd-7384-4569-b270-4b6083b23ca9-os-release\") pod \"multus-additional-cni-plugins-228r4\" (UID: \"5c1ccafd-7384-4569-b270-4b6083b23ca9\") " pod="openshift-multus/multus-additional-cni-plugins-228r4" Jul 30 12:59:14.789018 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.788952 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5c1ccafd-7384-4569-b270-4b6083b23ca9-cnibin\") pod \"multus-additional-cni-plugins-228r4\" (UID: \"5c1ccafd-7384-4569-b270-4b6083b23ca9\") " pod="openshift-multus/multus-additional-cni-plugins-228r4" Jul 30 12:59:14.789018 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.789016 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e4027c79-c8b8-4800-9db1-843170f52290-dbus\") pod \"global-pull-secret-syncer-xzq9h\" (UID: \"e4027c79-c8b8-4800-9db1-843170f52290\") " pod="kube-system/global-pull-secret-syncer-xzq9h" Jul 30 12:59:14.789536 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.789046 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5c1ccafd-7384-4569-b270-4b6083b23ca9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-228r4\" (UID: \"5c1ccafd-7384-4569-b270-4b6083b23ca9\") " pod="openshift-multus/multus-additional-cni-plugins-228r4" Jul 30 12:59:14.789536 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.789087 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4n2kd\" (UniqueName: \"kubernetes.io/projected/b4467d9b-3531-4231-8fa2-278fec9b2f6d-kube-api-access-4n2kd\") pod \"network-metrics-daemon-mrfm9\" (UID: \"b4467d9b-3531-4231-8fa2-278fec9b2f6d\") " pod="openshift-multus/network-metrics-daemon-mrfm9" Jul 30 12:59:14.789536 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.789112 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c1cb0fbf-c955-4c33-95fa-a70c1110aa3b-konnectivity-ca\") pod \"konnectivity-agent-cbrzj\" (UID: \"c1cb0fbf-c955-4c33-95fa-a70c1110aa3b\") " pod="kube-system/konnectivity-agent-cbrzj" Jul 30 12:59:14.789536 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:14.789199 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 30 12:59:14.789536 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:14.789274 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4467d9b-3531-4231-8fa2-278fec9b2f6d-metrics-certs podName:b4467d9b-3531-4231-8fa2-278fec9b2f6d nodeName:}" failed. No retries permitted until 2026-07-30 12:59:15.289261016 +0000 UTC m=+3.120727142 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b4467d9b-3531-4231-8fa2-278fec9b2f6d-metrics-certs") pod "network-metrics-daemon-mrfm9" (UID: "b4467d9b-3531-4231-8fa2-278fec9b2f6d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 30 12:59:14.789536 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.789332 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5c1ccafd-7384-4569-b270-4b6083b23ca9-system-cni-dir\") pod \"multus-additional-cni-plugins-228r4\" (UID: \"5c1ccafd-7384-4569-b270-4b6083b23ca9\") " pod="openshift-multus/multus-additional-cni-plugins-228r4" Jul 30 12:59:14.789536 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.789503 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5c1ccafd-7384-4569-b270-4b6083b23ca9-cni-binary-copy\") pod \"multus-additional-cni-plugins-228r4\" (UID: \"5c1ccafd-7384-4569-b270-4b6083b23ca9\") " pod="openshift-multus/multus-additional-cni-plugins-228r4" Jul 30 12:59:14.789955 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.789695 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5c1ccafd-7384-4569-b270-4b6083b23ca9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-228r4\" (UID: \"5c1ccafd-7384-4569-b270-4b6083b23ca9\") " pod="openshift-multus/multus-additional-cni-plugins-228r4" Jul 30 12:59:14.789955 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.789755 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c1cb0fbf-c955-4c33-95fa-a70c1110aa3b-konnectivity-ca\") pod \"konnectivity-agent-cbrzj\" (UID: \"c1cb0fbf-c955-4c33-95fa-a70c1110aa3b\") " pod="kube-system/konnectivity-agent-cbrzj" Jul 30 12:59:14.789955 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.789854 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5c1ccafd-7384-4569-b270-4b6083b23ca9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-228r4\" (UID: \"5c1ccafd-7384-4569-b270-4b6083b23ca9\") " pod="openshift-multus/multus-additional-cni-plugins-228r4" Jul 30 12:59:14.789955 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.789860 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8eca3445-f081-4f35-aa2c-603a2b80d815-serviceca\") pod \"node-ca-9cpnl\" (UID: \"8eca3445-f081-4f35-aa2c-603a2b80d815\") " pod="openshift-image-registry/node-ca-9cpnl" Jul 30 12:59:14.791956 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.791898 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c1cb0fbf-c955-4c33-95fa-a70c1110aa3b-agent-certs\") pod \"konnectivity-agent-cbrzj\" (UID: \"c1cb0fbf-c955-4c33-95fa-a70c1110aa3b\") " pod="kube-system/konnectivity-agent-cbrzj" Jul 30 12:59:14.800713 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.800681 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxbdd\" (UniqueName: \"kubernetes.io/projected/8eca3445-f081-4f35-aa2c-603a2b80d815-kube-api-access-dxbdd\") pod \"node-ca-9cpnl\" (UID: \"8eca3445-f081-4f35-aa2c-603a2b80d815\") " pod="openshift-image-registry/node-ca-9cpnl" Jul 30 12:59:14.801899 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.801873 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4n2kd\" (UniqueName: \"kubernetes.io/projected/b4467d9b-3531-4231-8fa2-278fec9b2f6d-kube-api-access-4n2kd\") pod \"network-metrics-daemon-mrfm9\" (UID: \"b4467d9b-3531-4231-8fa2-278fec9b2f6d\") " pod="openshift-multus/network-metrics-daemon-mrfm9" Jul 30 12:59:14.801992 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.801936 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-967kr\" (UniqueName: \"kubernetes.io/projected/5c1ccafd-7384-4569-b270-4b6083b23ca9-kube-api-access-967kr\") pod \"multus-additional-cni-plugins-228r4\" (UID: \"5c1ccafd-7384-4569-b270-4b6083b23ca9\") " pod="openshift-multus/multus-additional-cni-plugins-228r4" Jul 30 12:59:14.868261 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.868225 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rlk59" Jul 30 12:59:14.877718 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.877698 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zkflm" Jul 30 12:59:14.887214 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.887191 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nvcpn" Jul 30 12:59:14.895126 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.895102 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-24667" Jul 30 12:59:14.902765 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.902739 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-x7bbz" Jul 30 12:59:14.910487 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.910467 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5nn6b" Jul 30 12:59:14.918091 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.918069 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-228r4" Jul 30 12:59:14.924642 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.924621 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9cpnl" Jul 30 12:59:14.931223 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:14.931203 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cbrzj" Jul 30 12:59:15.291729 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:15.291698 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2c2lf\" (UniqueName: \"kubernetes.io/projected/24802bd2-a87c-440d-8ce9-1ef4780224d4-kube-api-access-2c2lf\") pod \"network-check-target-8vppx\" (UID: \"24802bd2-a87c-440d-8ce9-1ef4780224d4\") " pod="openshift-network-diagnostics/network-check-target-8vppx" Jul 30 12:59:15.291908 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:15.291745 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4467d9b-3531-4231-8fa2-278fec9b2f6d-metrics-certs\") pod \"network-metrics-daemon-mrfm9\" (UID: \"b4467d9b-3531-4231-8fa2-278fec9b2f6d\") " pod="openshift-multus/network-metrics-daemon-mrfm9" Jul 30 12:59:15.291908 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:15.291789 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e4027c79-c8b8-4800-9db1-843170f52290-original-pull-secret\") pod \"global-pull-secret-syncer-xzq9h\" (UID: \"e4027c79-c8b8-4800-9db1-843170f52290\") " pod="kube-system/global-pull-secret-syncer-xzq9h" Jul 30 12:59:15.291908 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:15.291876 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 30 12:59:15.291908 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:15.291897 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 30 12:59:15.291908 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:15.291909 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 30 12:59:15.292098 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:15.291920 2579 projected.go:196] Error preparing data for projected volume kube-api-access-2c2lf for pod openshift-network-diagnostics/network-check-target-8vppx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 30 12:59:15.292098 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:15.291876 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 30 12:59:15.292098 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:15.291952 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4027c79-c8b8-4800-9db1-843170f52290-original-pull-secret podName:e4027c79-c8b8-4800-9db1-843170f52290 nodeName:}" failed. No retries permitted until 2026-07-30 12:59:16.291933974 +0000 UTC m=+4.123400080 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e4027c79-c8b8-4800-9db1-843170f52290-original-pull-secret") pod "global-pull-secret-syncer-xzq9h" (UID: "e4027c79-c8b8-4800-9db1-843170f52290") : object "kube-system"/"original-pull-secret" not registered Jul 30 12:59:15.292098 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:15.291970 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/24802bd2-a87c-440d-8ce9-1ef4780224d4-kube-api-access-2c2lf podName:24802bd2-a87c-440d-8ce9-1ef4780224d4 nodeName:}" failed. No retries permitted until 2026-07-30 12:59:16.291960432 +0000 UTC m=+4.123426536 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-2c2lf" (UniqueName: "kubernetes.io/projected/24802bd2-a87c-440d-8ce9-1ef4780224d4-kube-api-access-2c2lf") pod "network-check-target-8vppx" (UID: "24802bd2-a87c-440d-8ce9-1ef4780224d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 30 12:59:15.292098 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:15.291987 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4467d9b-3531-4231-8fa2-278fec9b2f6d-metrics-certs podName:b4467d9b-3531-4231-8fa2-278fec9b2f6d nodeName:}" failed. No retries permitted until 2026-07-30 12:59:16.291977593 +0000 UTC m=+4.123443696 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b4467d9b-3531-4231-8fa2-278fec9b2f6d-metrics-certs") pod "network-metrics-daemon-mrfm9" (UID: "b4467d9b-3531-4231-8fa2-278fec9b2f6d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 30 12:59:15.626752 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:15.626634 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-29 12:54:14 +0000 UTC" deadline="2028-04-14 02:55:16.234469678 +0000 UTC" Jul 30 12:59:15.626752 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:15.626689 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14965h56m0.607785548s" Jul 30 12:59:15.712936 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:15.712913 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab45ff61_9eb3_4269_8007_d1e68fe130bc.slice/crio-1cc307fde2bbbe3d4ee6c8a59ccbde48827f5c33813e769a0683265d9ffe2747 WatchSource:0}: Error finding container 1cc307fde2bbbe3d4ee6c8a59ccbde48827f5c33813e769a0683265d9ffe2747: Status 404 returned error can't find the container with id 1cc307fde2bbbe3d4ee6c8a59ccbde48827f5c33813e769a0683265d9ffe2747 Jul 30 12:59:15.734786 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:15.734666 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4d9b0b7_6474_457f_b742_05d47589d56f.slice/crio-15d94462cc78416d2cc8d2586cc755a7fb576825b509805237c24cab4e48097c WatchSource:0}: Error finding container 15d94462cc78416d2cc8d2586cc755a7fb576825b509805237c24cab4e48097c: Status 404 returned error can't find the container with id 15d94462cc78416d2cc8d2586cc755a7fb576825b509805237c24cab4e48097c Jul 30 12:59:15.735403 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:15.735369 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1cb0fbf_c955_4c33_95fa_a70c1110aa3b.slice/crio-0fdcae0cb2775654af549db0f978939d202f293f71b9d67aa2430acaf0db08cd WatchSource:0}: Error finding container 0fdcae0cb2775654af549db0f978939d202f293f71b9d67aa2430acaf0db08cd: Status 404 returned error can't find the container with id 0fdcae0cb2775654af549db0f978939d202f293f71b9d67aa2430acaf0db08cd Jul 30 12:59:15.736740 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:15.736720 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode24a5fb7_4ae1_4766_99d4_c7a2e4f8d077.slice/crio-7a58f4d61f556daaf7d2fe6bc47bee45ed00d9e30ab7b4bf3c8d7eaf019a8940 WatchSource:0}: Error finding container 7a58f4d61f556daaf7d2fe6bc47bee45ed00d9e30ab7b4bf3c8d7eaf019a8940: Status 404 returned error can't find the container with id 7a58f4d61f556daaf7d2fe6bc47bee45ed00d9e30ab7b4bf3c8d7eaf019a8940 Jul 30 12:59:15.737654 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:15.737636 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4debd6c2_458e_46b6_9ac0_3aebd006c681.slice/crio-635e642ba9426ca0ae3863eca66bf09c8cd08c295b67d93b25f859ba63854f1e WatchSource:0}: Error finding container 635e642ba9426ca0ae3863eca66bf09c8cd08c295b67d93b25f859ba63854f1e: Status 404 returned error can't find the container with id 635e642ba9426ca0ae3863eca66bf09c8cd08c295b67d93b25f859ba63854f1e Jul 30 12:59:15.743899 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:15.743873 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e2a3f32_11fd_4bb5_9bdc_38ea06850d0b.slice/crio-7c78d79af40dc1ca6c7ef5d4d091d3c350efa7a61048b55f98a8d74862313317 WatchSource:0}: Error finding container 7c78d79af40dc1ca6c7ef5d4d091d3c350efa7a61048b55f98a8d74862313317: Status 404 returned error can't find the container with id 7c78d79af40dc1ca6c7ef5d4d091d3c350efa7a61048b55f98a8d74862313317 Jul 30 12:59:15.745390 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:15.745298 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8eca3445_f081_4f35_aa2c_603a2b80d815.slice/crio-991edd8ff2490b48173504c058d481dc0328a92defa64c473eff2a3749a951ec WatchSource:0}: Error finding container 991edd8ff2490b48173504c058d481dc0328a92defa64c473eff2a3749a951ec: Status 404 returned error can't find the container with id 991edd8ff2490b48173504c058d481dc0328a92defa64c473eff2a3749a951ec Jul 30 12:59:15.746087 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:15.746063 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0659b9a4_1828_4bd3_a1d9_b493d7fd6693.slice/crio-51e57db6330f160f858307e880980387a94114a418d457fcdd36a9fd740864d3 WatchSource:0}: Error finding container 51e57db6330f160f858307e880980387a94114a418d457fcdd36a9fd740864d3: Status 404 returned error can't find the container with id 51e57db6330f160f858307e880980387a94114a418d457fcdd36a9fd740864d3 Jul 30 12:59:15.748316 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:15.748279 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c1ccafd_7384_4569_b270_4b6083b23ca9.slice/crio-7ddf83bc4abe4205f053bc74f5e3dc8511d91addaf0bb868c7b2a844e4fdbd42 WatchSource:0}: Error finding container 7ddf83bc4abe4205f053bc74f5e3dc8511d91addaf0bb868c7b2a844e4fdbd42: Status 404 returned error can't find the container with id 7ddf83bc4abe4205f053bc74f5e3dc8511d91addaf0bb868c7b2a844e4fdbd42 Jul 30 12:59:16.297562 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:16.297522 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e4027c79-c8b8-4800-9db1-843170f52290-original-pull-secret\") pod \"global-pull-secret-syncer-xzq9h\" (UID: \"e4027c79-c8b8-4800-9db1-843170f52290\") " pod="kube-system/global-pull-secret-syncer-xzq9h" Jul 30 12:59:16.297780 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:16.297593 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2c2lf\" (UniqueName: \"kubernetes.io/projected/24802bd2-a87c-440d-8ce9-1ef4780224d4-kube-api-access-2c2lf\") pod \"network-check-target-8vppx\" (UID: \"24802bd2-a87c-440d-8ce9-1ef4780224d4\") " pod="openshift-network-diagnostics/network-check-target-8vppx" Jul 30 12:59:16.297780 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:16.297619 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4467d9b-3531-4231-8fa2-278fec9b2f6d-metrics-certs\") pod \"network-metrics-daemon-mrfm9\" (UID: \"b4467d9b-3531-4231-8fa2-278fec9b2f6d\") " pod="openshift-multus/network-metrics-daemon-mrfm9" Jul 30 12:59:16.297780 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:16.297735 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 30 12:59:16.297928 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:16.297797 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4467d9b-3531-4231-8fa2-278fec9b2f6d-metrics-certs podName:b4467d9b-3531-4231-8fa2-278fec9b2f6d nodeName:}" failed. No retries permitted until 2026-07-30 12:59:18.297779297 +0000 UTC m=+6.129245400 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b4467d9b-3531-4231-8fa2-278fec9b2f6d-metrics-certs") pod "network-metrics-daemon-mrfm9" (UID: "b4467d9b-3531-4231-8fa2-278fec9b2f6d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 30 12:59:16.298243 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:16.298221 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 30 12:59:16.298351 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:16.298280 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4027c79-c8b8-4800-9db1-843170f52290-original-pull-secret podName:e4027c79-c8b8-4800-9db1-843170f52290 nodeName:}" failed. No retries permitted until 2026-07-30 12:59:18.298264353 +0000 UTC m=+6.129730473 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e4027c79-c8b8-4800-9db1-843170f52290-original-pull-secret") pod "global-pull-secret-syncer-xzq9h" (UID: "e4027c79-c8b8-4800-9db1-843170f52290") : object "kube-system"/"original-pull-secret" not registered Jul 30 12:59:16.298436 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:16.298360 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 30 12:59:16.298436 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:16.298375 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 30 12:59:16.298436 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:16.298387 2579 projected.go:196] Error preparing data for projected volume kube-api-access-2c2lf for pod openshift-network-diagnostics/network-check-target-8vppx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 30 12:59:16.298605 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:16.298443 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/24802bd2-a87c-440d-8ce9-1ef4780224d4-kube-api-access-2c2lf podName:24802bd2-a87c-440d-8ce9-1ef4780224d4 nodeName:}" failed. No retries permitted until 2026-07-30 12:59:18.298430583 +0000 UTC m=+6.129896696 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-2c2lf" (UniqueName: "kubernetes.io/projected/24802bd2-a87c-440d-8ce9-1ef4780224d4-kube-api-access-2c2lf") pod "network-check-target-8vppx" (UID: "24802bd2-a87c-440d-8ce9-1ef4780224d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 30 12:59:16.627493 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:16.627360 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-29 12:54:14 +0000 UTC" deadline="2028-03-04 09:10:27.384425915 +0000 UTC" Jul 30 12:59:16.627493 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:16.627400 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13988h11m10.757030404s" Jul 30 12:59:16.707590 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:16.707553 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xzq9h" Jul 30 12:59:16.707590 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:16.707581 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrfm9" Jul 30 12:59:16.707820 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:16.707587 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vppx" Jul 30 12:59:16.707820 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:16.707739 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xzq9h" podUID="e4027c79-c8b8-4800-9db1-843170f52290" Jul 30 12:59:16.707941 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:16.707914 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrfm9" podUID="b4467d9b-3531-4231-8fa2-278fec9b2f6d" Jul 30 12:59:16.708064 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:16.708045 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vppx" podUID="24802bd2-a87c-440d-8ce9-1ef4780224d4" Jul 30 12:59:16.734918 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:16.733817 2579 generic.go:356] "Generic (PLEG): container finished" podID="66d7deccf1aa4e927a9cf89772adac78" containerID="94c6de04010cedef62d8535b8756dda85294291aea2944e4150dbe059e67b822" exitCode=0 Jul 30 12:59:16.734918 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:16.733937 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-230.ec2.internal" event={"ID":"66d7deccf1aa4e927a9cf89772adac78","Type":"ContainerDied","Data":"94c6de04010cedef62d8535b8756dda85294291aea2944e4150dbe059e67b822"} Jul 30 12:59:16.747557 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:16.747520 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-228r4" event={"ID":"5c1ccafd-7384-4569-b270-4b6083b23ca9","Type":"ContainerStarted","Data":"7ddf83bc4abe4205f053bc74f5e3dc8511d91addaf0bb868c7b2a844e4fdbd42"} Jul 30 12:59:16.761927 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:16.761889 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rlk59" event={"ID":"0659b9a4-1828-4bd3-a1d9-b493d7fd6693","Type":"ContainerStarted","Data":"51e57db6330f160f858307e880980387a94114a418d457fcdd36a9fd740864d3"} Jul 30 12:59:16.777064 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:16.777033 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zkflm" event={"ID":"e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077","Type":"ContainerStarted","Data":"7a58f4d61f556daaf7d2fe6bc47bee45ed00d9e30ab7b4bf3c8d7eaf019a8940"} Jul 30 12:59:16.799911 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:16.799869 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nvcpn" event={"ID":"ab45ff61-9eb3-4269-8007-d1e68fe130bc","Type":"ContainerStarted","Data":"1cc307fde2bbbe3d4ee6c8a59ccbde48827f5c33813e769a0683265d9ffe2747"} Jul 30 12:59:16.823093 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:16.823057 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-230.ec2.internal" event={"ID":"b39ac35dac0bf47dea91e3680de30c40","Type":"ContainerStarted","Data":"d39240f1781e19b4a226a952465d5414112795c9567369edfb2b0727699c0994"} Jul 30 12:59:16.831891 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:16.831808 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9cpnl" event={"ID":"8eca3445-f081-4f35-aa2c-603a2b80d815","Type":"ContainerStarted","Data":"991edd8ff2490b48173504c058d481dc0328a92defa64c473eff2a3749a951ec"} Jul 30 12:59:16.838212 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:16.838119 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-24667" event={"ID":"4debd6c2-458e-46b6-9ac0-3aebd006c681","Type":"ContainerStarted","Data":"635e642ba9426ca0ae3863eca66bf09c8cd08c295b67d93b25f859ba63854f1e"} Jul 30 12:59:16.851895 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:16.851858 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5nn6b" event={"ID":"1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b","Type":"ContainerStarted","Data":"7c78d79af40dc1ca6c7ef5d4d091d3c350efa7a61048b55f98a8d74862313317"} Jul 30 12:59:16.878719 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:16.878633 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cbrzj" event={"ID":"c1cb0fbf-c955-4c33-95fa-a70c1110aa3b","Type":"ContainerStarted","Data":"0fdcae0cb2775654af549db0f978939d202f293f71b9d67aa2430acaf0db08cd"} Jul 30 12:59:16.884717 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:16.884685 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-x7bbz" event={"ID":"a4d9b0b7-6474-457f-b742-05d47589d56f","Type":"ContainerStarted","Data":"15d94462cc78416d2cc8d2586cc755a7fb576825b509805237c24cab4e48097c"} Jul 30 12:59:17.906937 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:17.906896 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-230.ec2.internal" event={"ID":"66d7deccf1aa4e927a9cf89772adac78","Type":"ContainerStarted","Data":"48a9b2f490ec41ac3eb52190480ade14512e934fa6e6553398c87dd5caddb806"} Jul 30 12:59:17.923879 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:17.923638 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-230.ec2.internal" podStartSLOduration=4.923616579 podStartE2EDuration="4.923616579s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 12:59:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 12:59:16.840235509 +0000 UTC m=+4.671701636" watchObservedRunningTime="2026-07-30 12:59:17.923616579 +0000 UTC m=+5.755082706" Jul 30 12:59:17.923879 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:17.923778 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-230.ec2.internal" podStartSLOduration=4.923772522 podStartE2EDuration="4.923772522s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 12:59:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 12:59:17.92294654 +0000 UTC m=+5.754412666" watchObservedRunningTime="2026-07-30 12:59:17.923772522 +0000 UTC m=+5.755238649" Jul 30 12:59:18.315630 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:18.315588 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2c2lf\" (UniqueName: \"kubernetes.io/projected/24802bd2-a87c-440d-8ce9-1ef4780224d4-kube-api-access-2c2lf\") pod \"network-check-target-8vppx\" (UID: \"24802bd2-a87c-440d-8ce9-1ef4780224d4\") " pod="openshift-network-diagnostics/network-check-target-8vppx" Jul 30 12:59:18.315832 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:18.315645 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4467d9b-3531-4231-8fa2-278fec9b2f6d-metrics-certs\") pod \"network-metrics-daemon-mrfm9\" (UID: \"b4467d9b-3531-4231-8fa2-278fec9b2f6d\") " pod="openshift-multus/network-metrics-daemon-mrfm9" Jul 30 12:59:18.315832 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:18.315693 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e4027c79-c8b8-4800-9db1-843170f52290-original-pull-secret\") pod \"global-pull-secret-syncer-xzq9h\" (UID: \"e4027c79-c8b8-4800-9db1-843170f52290\") " pod="kube-system/global-pull-secret-syncer-xzq9h" Jul 30 12:59:18.315832 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:18.315804 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 30 12:59:18.315989 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:18.315854 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 30 12:59:18.315989 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:18.315867 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4467d9b-3531-4231-8fa2-278fec9b2f6d-metrics-certs podName:b4467d9b-3531-4231-8fa2-278fec9b2f6d nodeName:}" failed. No retries permitted until 2026-07-30 12:59:22.315848673 +0000 UTC m=+10.147314793 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b4467d9b-3531-4231-8fa2-278fec9b2f6d-metrics-certs") pod "network-metrics-daemon-mrfm9" (UID: "b4467d9b-3531-4231-8fa2-278fec9b2f6d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 30 12:59:18.315989 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:18.315890 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4027c79-c8b8-4800-9db1-843170f52290-original-pull-secret podName:e4027c79-c8b8-4800-9db1-843170f52290 nodeName:}" failed. No retries permitted until 2026-07-30 12:59:22.315880233 +0000 UTC m=+10.147346345 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e4027c79-c8b8-4800-9db1-843170f52290-original-pull-secret") pod "global-pull-secret-syncer-xzq9h" (UID: "e4027c79-c8b8-4800-9db1-843170f52290") : object "kube-system"/"original-pull-secret" not registered Jul 30 12:59:18.315989 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:18.315810 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 30 12:59:18.315989 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:18.315913 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 30 12:59:18.315989 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:18.315925 2579 projected.go:196] Error preparing data for projected volume kube-api-access-2c2lf for pod openshift-network-diagnostics/network-check-target-8vppx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 30 12:59:18.315989 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:18.315953 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/24802bd2-a87c-440d-8ce9-1ef4780224d4-kube-api-access-2c2lf podName:24802bd2-a87c-440d-8ce9-1ef4780224d4 nodeName:}" failed. No retries permitted until 2026-07-30 12:59:22.315945247 +0000 UTC m=+10.147411351 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-2c2lf" (UniqueName: "kubernetes.io/projected/24802bd2-a87c-440d-8ce9-1ef4780224d4-kube-api-access-2c2lf") pod "network-check-target-8vppx" (UID: "24802bd2-a87c-440d-8ce9-1ef4780224d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 30 12:59:18.702543 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:18.702512 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vppx" Jul 30 12:59:18.702716 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:18.702529 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrfm9" Jul 30 12:59:18.702716 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:18.702640 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xzq9h" Jul 30 12:59:18.702716 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:18.702650 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vppx" podUID="24802bd2-a87c-440d-8ce9-1ef4780224d4" Jul 30 12:59:18.702878 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:18.702762 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrfm9" podUID="b4467d9b-3531-4231-8fa2-278fec9b2f6d" Jul 30 12:59:18.702878 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:18.702847 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xzq9h" podUID="e4027c79-c8b8-4800-9db1-843170f52290" Jul 30 12:59:20.701434 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:20.701345 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrfm9" Jul 30 12:59:20.701434 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:20.701374 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vppx" Jul 30 12:59:20.701946 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:20.701504 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrfm9" podUID="b4467d9b-3531-4231-8fa2-278fec9b2f6d" Jul 30 12:59:20.701946 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:20.701885 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xzq9h" Jul 30 12:59:20.702059 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:20.701992 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xzq9h" podUID="e4027c79-c8b8-4800-9db1-843170f52290" Jul 30 12:59:20.708069 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:20.708034 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vppx" podUID="24802bd2-a87c-440d-8ce9-1ef4780224d4" Jul 30 12:59:22.350777 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:22.350737 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2c2lf\" (UniqueName: \"kubernetes.io/projected/24802bd2-a87c-440d-8ce9-1ef4780224d4-kube-api-access-2c2lf\") pod \"network-check-target-8vppx\" (UID: \"24802bd2-a87c-440d-8ce9-1ef4780224d4\") " pod="openshift-network-diagnostics/network-check-target-8vppx" Jul 30 12:59:22.351266 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:22.350791 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4467d9b-3531-4231-8fa2-278fec9b2f6d-metrics-certs\") pod \"network-metrics-daemon-mrfm9\" (UID: \"b4467d9b-3531-4231-8fa2-278fec9b2f6d\") " pod="openshift-multus/network-metrics-daemon-mrfm9" Jul 30 12:59:22.351266 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:22.350836 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e4027c79-c8b8-4800-9db1-843170f52290-original-pull-secret\") pod \"global-pull-secret-syncer-xzq9h\" (UID: \"e4027c79-c8b8-4800-9db1-843170f52290\") " pod="kube-system/global-pull-secret-syncer-xzq9h" Jul 30 12:59:22.351266 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:22.350909 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 30 12:59:22.351266 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:22.350932 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 30 12:59:22.351266 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:22.350946 2579 projected.go:196] Error preparing data for projected volume kube-api-access-2c2lf for pod openshift-network-diagnostics/network-check-target-8vppx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 30 12:59:22.351266 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:22.350950 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 30 12:59:22.351266 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:22.350952 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 30 12:59:22.351266 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:22.350996 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/24802bd2-a87c-440d-8ce9-1ef4780224d4-kube-api-access-2c2lf podName:24802bd2-a87c-440d-8ce9-1ef4780224d4 nodeName:}" failed. No retries permitted until 2026-07-30 12:59:30.350978785 +0000 UTC m=+18.182444902 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-2c2lf" (UniqueName: "kubernetes.io/projected/24802bd2-a87c-440d-8ce9-1ef4780224d4-kube-api-access-2c2lf") pod "network-check-target-8vppx" (UID: "24802bd2-a87c-440d-8ce9-1ef4780224d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 30 12:59:22.351266 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:22.351015 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4027c79-c8b8-4800-9db1-843170f52290-original-pull-secret podName:e4027c79-c8b8-4800-9db1-843170f52290 nodeName:}" failed. No retries permitted until 2026-07-30 12:59:30.351005961 +0000 UTC m=+18.182472069 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e4027c79-c8b8-4800-9db1-843170f52290-original-pull-secret") pod "global-pull-secret-syncer-xzq9h" (UID: "e4027c79-c8b8-4800-9db1-843170f52290") : object "kube-system"/"original-pull-secret" not registered Jul 30 12:59:22.351266 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:22.351030 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4467d9b-3531-4231-8fa2-278fec9b2f6d-metrics-certs podName:b4467d9b-3531-4231-8fa2-278fec9b2f6d nodeName:}" failed. No retries permitted until 2026-07-30 12:59:30.35102147 +0000 UTC m=+18.182487588 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b4467d9b-3531-4231-8fa2-278fec9b2f6d-metrics-certs") pod "network-metrics-daemon-mrfm9" (UID: "b4467d9b-3531-4231-8fa2-278fec9b2f6d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 30 12:59:22.703453 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:22.702621 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vppx" Jul 30 12:59:22.703453 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:22.702742 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vppx" podUID="24802bd2-a87c-440d-8ce9-1ef4780224d4" Jul 30 12:59:22.703453 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:22.703157 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrfm9" Jul 30 12:59:22.703453 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:22.703259 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrfm9" podUID="b4467d9b-3531-4231-8fa2-278fec9b2f6d" Jul 30 12:59:22.703453 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:22.703324 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xzq9h" Jul 30 12:59:22.703453 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:22.703395 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xzq9h" podUID="e4027c79-c8b8-4800-9db1-843170f52290" Jul 30 12:59:24.702099 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:24.701612 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xzq9h" Jul 30 12:59:24.702099 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:24.701646 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vppx" Jul 30 12:59:24.702099 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:24.701612 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrfm9" Jul 30 12:59:24.702099 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:24.701749 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xzq9h" podUID="e4027c79-c8b8-4800-9db1-843170f52290" Jul 30 12:59:24.702099 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:24.701836 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrfm9" podUID="b4467d9b-3531-4231-8fa2-278fec9b2f6d" Jul 30 12:59:24.702099 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:24.701920 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vppx" podUID="24802bd2-a87c-440d-8ce9-1ef4780224d4" Jul 30 12:59:26.701784 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:26.701741 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vppx" Jul 30 12:59:26.702287 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:26.701741 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xzq9h" Jul 30 12:59:26.702287 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:26.701871 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrfm9" Jul 30 12:59:26.702287 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:26.701882 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vppx" podUID="24802bd2-a87c-440d-8ce9-1ef4780224d4" Jul 30 12:59:26.702287 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:26.701967 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xzq9h" podUID="e4027c79-c8b8-4800-9db1-843170f52290" Jul 30 12:59:26.702287 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:26.702108 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrfm9" podUID="b4467d9b-3531-4231-8fa2-278fec9b2f6d" Jul 30 12:59:28.702056 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:28.702016 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vppx" Jul 30 12:59:28.702518 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:28.702020 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrfm9" Jul 30 12:59:28.702518 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:28.702147 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vppx" podUID="24802bd2-a87c-440d-8ce9-1ef4780224d4" Jul 30 12:59:28.702518 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:28.702020 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xzq9h" Jul 30 12:59:28.702518 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:28.702263 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrfm9" podUID="b4467d9b-3531-4231-8fa2-278fec9b2f6d" Jul 30 12:59:28.702518 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:28.702387 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xzq9h" podUID="e4027c79-c8b8-4800-9db1-843170f52290" Jul 30 12:59:30.416364 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:30.416330 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e4027c79-c8b8-4800-9db1-843170f52290-original-pull-secret\") pod \"global-pull-secret-syncer-xzq9h\" (UID: \"e4027c79-c8b8-4800-9db1-843170f52290\") " pod="kube-system/global-pull-secret-syncer-xzq9h" Jul 30 12:59:30.416757 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:30.416377 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2c2lf\" (UniqueName: \"kubernetes.io/projected/24802bd2-a87c-440d-8ce9-1ef4780224d4-kube-api-access-2c2lf\") pod \"network-check-target-8vppx\" (UID: \"24802bd2-a87c-440d-8ce9-1ef4780224d4\") " pod="openshift-network-diagnostics/network-check-target-8vppx" Jul 30 12:59:30.416757 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:30.416483 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 30 12:59:30.416757 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:30.416498 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4467d9b-3531-4231-8fa2-278fec9b2f6d-metrics-certs\") pod \"network-metrics-daemon-mrfm9\" (UID: \"b4467d9b-3531-4231-8fa2-278fec9b2f6d\") " pod="openshift-multus/network-metrics-daemon-mrfm9" Jul 30 12:59:30.416757 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:30.416502 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 30 12:59:30.416757 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:30.416543 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4027c79-c8b8-4800-9db1-843170f52290-original-pull-secret podName:e4027c79-c8b8-4800-9db1-843170f52290 nodeName:}" failed. No retries permitted until 2026-07-30 12:59:46.416525721 +0000 UTC m=+34.247991829 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e4027c79-c8b8-4800-9db1-843170f52290-original-pull-secret") pod "global-pull-secret-syncer-xzq9h" (UID: "e4027c79-c8b8-4800-9db1-843170f52290") : object "kube-system"/"original-pull-secret" not registered Jul 30 12:59:30.416757 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:30.416552 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 30 12:59:30.416757 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:30.416557 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 30 12:59:30.416757 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:30.416567 2579 projected.go:196] Error preparing data for projected volume kube-api-access-2c2lf for pod openshift-network-diagnostics/network-check-target-8vppx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 30 12:59:30.416757 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:30.416612 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4467d9b-3531-4231-8fa2-278fec9b2f6d-metrics-certs podName:b4467d9b-3531-4231-8fa2-278fec9b2f6d nodeName:}" failed. No retries permitted until 2026-07-30 12:59:46.416596919 +0000 UTC m=+34.248063022 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b4467d9b-3531-4231-8fa2-278fec9b2f6d-metrics-certs") pod "network-metrics-daemon-mrfm9" (UID: "b4467d9b-3531-4231-8fa2-278fec9b2f6d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 30 12:59:30.416757 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:30.416626 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/24802bd2-a87c-440d-8ce9-1ef4780224d4-kube-api-access-2c2lf podName:24802bd2-a87c-440d-8ce9-1ef4780224d4 nodeName:}" failed. No retries permitted until 2026-07-30 12:59:46.4166198 +0000 UTC m=+34.248085902 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-2c2lf" (UniqueName: "kubernetes.io/projected/24802bd2-a87c-440d-8ce9-1ef4780224d4-kube-api-access-2c2lf") pod "network-check-target-8vppx" (UID: "24802bd2-a87c-440d-8ce9-1ef4780224d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 30 12:59:30.701165 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:30.701131 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vppx" Jul 30 12:59:30.701335 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:30.701138 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xzq9h" Jul 30 12:59:30.701335 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:30.701252 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vppx" podUID="24802bd2-a87c-440d-8ce9-1ef4780224d4" Jul 30 12:59:30.701480 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:30.701138 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrfm9" Jul 30 12:59:30.701480 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:30.701377 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xzq9h" podUID="e4027c79-c8b8-4800-9db1-843170f52290" Jul 30 12:59:30.701559 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:30.701502 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrfm9" podUID="b4467d9b-3531-4231-8fa2-278fec9b2f6d" Jul 30 12:59:32.702350 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:32.702312 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vppx" Jul 30 12:59:32.702835 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:32.702425 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vppx" podUID="24802bd2-a87c-440d-8ce9-1ef4780224d4" Jul 30 12:59:32.702835 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:32.702493 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrfm9" Jul 30 12:59:32.702835 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:32.702598 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrfm9" podUID="b4467d9b-3531-4231-8fa2-278fec9b2f6d" Jul 30 12:59:32.702835 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:32.702641 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xzq9h" Jul 30 12:59:32.702835 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:32.702689 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xzq9h" podUID="e4027c79-c8b8-4800-9db1-843170f52290" Jul 30 12:59:34.701581 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:34.701242 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrfm9" Jul 30 12:59:34.702104 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:34.701250 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vppx" Jul 30 12:59:34.702104 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:34.701677 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrfm9" podUID="b4467d9b-3531-4231-8fa2-278fec9b2f6d" Jul 30 12:59:34.702104 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:34.701318 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xzq9h" Jul 30 12:59:34.702104 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:34.701746 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vppx" podUID="24802bd2-a87c-440d-8ce9-1ef4780224d4" Jul 30 12:59:34.702104 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:34.701815 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xzq9h" podUID="e4027c79-c8b8-4800-9db1-843170f52290" Jul 30 12:59:34.943076 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:34.943036 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9cpnl" event={"ID":"8eca3445-f081-4f35-aa2c-603a2b80d815","Type":"ContainerStarted","Data":"6c3329948e3313e38efabe8823c6f0e9af2d6e2a118aec2b691d9c8237d15efc"} Jul 30 12:59:34.944664 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:34.944639 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-24667" event={"ID":"4debd6c2-458e-46b6-9ac0-3aebd006c681","Type":"ContainerStarted","Data":"5dda53adb327b2321792341e22493a6347d403fc42c955357b845b044a4bc581"} Jul 30 12:59:34.946157 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:34.946136 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5nn6b" event={"ID":"1e2a3f32-11fd-4bb5-9bdc-38ea06850d0b","Type":"ContainerStarted","Data":"76a1fe0b96111bfc7a95826c77d1b446237c4683eaf0c60e685b763e2ba6a888"} Jul 30 12:59:34.947581 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:34.947559 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cbrzj" event={"ID":"c1cb0fbf-c955-4c33-95fa-a70c1110aa3b","Type":"ContainerStarted","Data":"fd2b30bb1bb25b6abdeb95124531ce69db721a29fb519ba6384b6f64394605be"} Jul 30 12:59:34.949059 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:34.948976 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-x7bbz" event={"ID":"a4d9b0b7-6474-457f-b742-05d47589d56f","Type":"ContainerStarted","Data":"3fa37870bfb785e93022e4325cc493f6d6b8286e38d804318d9dddaf91257922"} Jul 30 12:59:34.950325 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:34.950299 2579 generic.go:356] "Generic (PLEG): container finished" podID="5c1ccafd-7384-4569-b270-4b6083b23ca9" containerID="3fac2e6b14a796eeb38cf43a28c0f691ac9b656eea045673f0da6841cdb116e2" exitCode=0 Jul 30 12:59:34.950427 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:34.950335 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-228r4" event={"ID":"5c1ccafd-7384-4569-b270-4b6083b23ca9","Type":"ContainerDied","Data":"3fac2e6b14a796eeb38cf43a28c0f691ac9b656eea045673f0da6841cdb116e2"} Jul 30 12:59:34.953502 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:34.953479 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zkflm" event={"ID":"e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077","Type":"ContainerStarted","Data":"f5a61229fee575f246f27a298f3fb6fbfd200b233eb6bd35a17337e8b3e1f63b"} Jul 30 12:59:34.953589 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:34.953551 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zkflm" event={"ID":"e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077","Type":"ContainerStarted","Data":"c36ab4d2fe7e6ed2c2d8b69bb2a46e5ed948cace31aa00afe7b8259c5e315d8e"} Jul 30 12:59:34.953647 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:34.953596 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zkflm" event={"ID":"e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077","Type":"ContainerStarted","Data":"f291e992e788451547969bea539dfad9125ed5c2f65ed2f8a3c24fb1f6d40f4f"} Jul 30 12:59:34.953647 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:34.953628 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zkflm" event={"ID":"e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077","Type":"ContainerStarted","Data":"9496f8939c5bc6e95517c2fc72a1fdca707f335681d24084adf334775ce50d5b"} Jul 30 12:59:34.953729 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:34.953674 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zkflm" event={"ID":"e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077","Type":"ContainerStarted","Data":"a4c32afb0b4ec7cc76a9baaf31260c9b46b5c18c7256afbe0361dbdaa8a51177"} Jul 30 12:59:34.953729 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:34.953720 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zkflm" event={"ID":"e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077","Type":"ContainerStarted","Data":"68bda9ee079f4d36f6423988cd197f0c8bb180f5041966e6629f823f49899cfa"} Jul 30 12:59:34.954968 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:34.954949 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nvcpn" event={"ID":"ab45ff61-9eb3-4269-8007-d1e68fe130bc","Type":"ContainerStarted","Data":"945a46db1bce3c2794fec371bf81f1a9a8c0022f3d0a3f7ec1c290b9f9295b59"} Jul 30 12:59:34.959182 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:34.959140 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-9cpnl" podStartSLOduration=3.500514926 podStartE2EDuration="21.959128365s" totalImagesPullingTime="18.458613439s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 12:59:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 12:59:34.958784066 +0000 UTC m=+22.790250192" watchObservedRunningTime="2026-07-30 12:59:34.959128365 +0000 UTC m=+22.790594490" Jul 30 12:59:34.975748 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:34.975706 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-24667" podStartSLOduration=4.494715865 podStartE2EDuration="22.975691863s" totalImagesPullingTime="18.480975998s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 12:59:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 12:59:34.975219837 +0000 UTC m=+22.806685961" watchObservedRunningTime="2026-07-30 12:59:34.975691863 +0000 UTC m=+22.807157988" Jul 30 12:59:34.990790 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:34.990748 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-cbrzj" podStartSLOduration=11.398534207 podStartE2EDuration="21.990732631s" totalImagesPullingTime="10.592198424s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 12:59:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 12:59:34.990368466 +0000 UTC m=+22.821834591" watchObservedRunningTime="2026-07-30 12:59:34.990732631 +0000 UTC m=+22.822198734" Jul 30 12:59:35.011913 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:35.011872 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-x7bbz" podStartSLOduration=4.541486007 podStartE2EDuration="23.011858102s" totalImagesPullingTime="18.470372095s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 12:59:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 12:59:35.011677797 +0000 UTC m=+22.843143922" watchObservedRunningTime="2026-07-30 12:59:35.011858102 +0000 UTC m=+22.843324226" Jul 30 12:59:35.039289 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:35.039246 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-5nn6b" podStartSLOduration=3.519140438 podStartE2EDuration="22.039231581s" totalImagesPullingTime="18.520091143s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 12:59:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 12:59:35.038926644 +0000 UTC m=+22.870392770" watchObservedRunningTime="2026-07-30 12:59:35.039231581 +0000 UTC m=+22.870697705" Jul 30 12:59:35.959317 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:35.959278 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rlk59" event={"ID":"0659b9a4-1828-4bd3-a1d9-b493d7fd6693","Type":"ContainerStarted","Data":"dff213fd6ef5996dabe9c0774694a8ae09a5ee0a035ca25f0f022730266d91e6"} Jul 30 12:59:36.049084 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:36.049056 2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 30 12:59:36.636225 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:36.636026 2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-30T12:59:36.049079587Z","UUID":"425fd026-b9ee-4e98-a119-1a0549a0f9c1","Handler":null,"Name":"","Endpoint":""} Jul 30 12:59:36.637820 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:36.637793 2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 30 12:59:36.637958 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:36.637839 2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 30 12:59:36.701944 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:36.701895 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vppx" Jul 30 12:59:36.702129 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:36.701895 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrfm9" Jul 30 12:59:36.702129 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:36.702012 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vppx" podUID="24802bd2-a87c-440d-8ce9-1ef4780224d4" Jul 30 12:59:36.702246 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:36.702121 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrfm9" podUID="b4467d9b-3531-4231-8fa2-278fec9b2f6d" Jul 30 12:59:36.702246 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:36.701910 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xzq9h" Jul 30 12:59:36.702246 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:36.702223 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xzq9h" podUID="e4027c79-c8b8-4800-9db1-843170f52290" Jul 30 12:59:36.965444 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:36.964937 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nvcpn" event={"ID":"ab45ff61-9eb3-4269-8007-d1e68fe130bc","Type":"ContainerStarted","Data":"fb5d5afef23f2a3963a3040bf0e14ca690fedc3bb5b24c90a9a4e24832a5b0d8"} Jul 30 12:59:37.971733 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:37.971484 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zkflm" event={"ID":"e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077","Type":"ContainerStarted","Data":"dbd2fbe959dcbb18c22cfa9183b492a576791ce907b5460aa2f445762c5ddbd8"} Jul 30 12:59:37.973906 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:37.973868 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nvcpn" event={"ID":"ab45ff61-9eb3-4269-8007-d1e68fe130bc","Type":"ContainerStarted","Data":"cc68bf59eebcf552f3f536c7de9c4dfbfb2cc29bfa430e899f4b1a47267698fd"} Jul 30 12:59:37.991356 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:37.991308 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-rlk59" podStartSLOduration=7.533999134 podStartE2EDuration="25.991289362s" totalImagesPullingTime="18.457290228s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 12:59:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 12:59:35.975538373 +0000 UTC m=+23.807004497" watchObservedRunningTime="2026-07-30 12:59:37.991289362 +0000 UTC m=+25.822755488" Jul 30 12:59:37.991634 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:37.991606 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nvcpn" podStartSLOduration=4.671019672 podStartE2EDuration="25.991599873s" totalImagesPullingTime="21.320580201s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 12:59:12 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 12:59:37.991119414 +0000 UTC m=+25.822585550" watchObservedRunningTime="2026-07-30 12:59:37.991599873 +0000 UTC m=+25.823065997" Jul 30 12:59:38.701224 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:38.701189 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrfm9" Jul 30 12:59:38.701473 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:38.701189 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vppx" Jul 30 12:59:38.701473 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:38.701189 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xzq9h" Jul 30 12:59:38.701473 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:38.701366 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrfm9" podUID="b4467d9b-3531-4231-8fa2-278fec9b2f6d" Jul 30 12:59:38.701651 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:38.701468 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vppx" podUID="24802bd2-a87c-440d-8ce9-1ef4780224d4" Jul 30 12:59:38.701651 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:38.701545 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xzq9h" podUID="e4027c79-c8b8-4800-9db1-843170f52290" Jul 30 12:59:39.526942 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:39.526843 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-cbrzj" Jul 30 12:59:39.527664 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:39.527644 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-cbrzj" Jul 30 12:59:39.981801 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:39.981624 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zkflm" event={"ID":"e24a5fb7-4ae1-4766-99d4-c7a2e4f8d077","Type":"ContainerStarted","Data":"3947966140d5a4f6ee7846c4fdf212aff477284210e878415c35578c6d4799bf"} Jul 30 12:59:39.985112 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:39.985076 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-cbrzj" Jul 30 12:59:39.985399 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:39.985319 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zkflm" Jul 30 12:59:39.985635 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:39.985618 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-cbrzj" Jul 30 12:59:40.003181 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:40.003160 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zkflm" Jul 30 12:59:40.011549 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:40.011501 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-zkflm" podStartSLOduration=9.477794478 podStartE2EDuration="28.011484297s" totalImagesPullingTime="18.533689819s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 12:59:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 12:59:40.011034081 +0000 UTC m=+27.842500240" watchObservedRunningTime="2026-07-30 12:59:40.011484297 +0000 UTC m=+27.842950423" Jul 30 12:59:40.702086 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:40.702052 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrfm9" Jul 30 12:59:40.702696 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:40.702053 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vppx" Jul 30 12:59:40.702696 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:40.702180 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xzq9h" Jul 30 12:59:40.702696 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:40.702207 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrfm9" podUID="b4467d9b-3531-4231-8fa2-278fec9b2f6d" Jul 30 12:59:40.702696 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:40.702258 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vppx" podUID="24802bd2-a87c-440d-8ce9-1ef4780224d4" Jul 30 12:59:40.702696 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:40.702320 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xzq9h" podUID="e4027c79-c8b8-4800-9db1-843170f52290" Jul 30 12:59:40.992674 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:40.986679 2579 generic.go:356] "Generic (PLEG): container finished" podID="5c1ccafd-7384-4569-b270-4b6083b23ca9" containerID="a2bed2aaa8c4d7da560f4b56a27ab6e7e769a8853a3ba22bfe9c634f12a7e573" exitCode=0 Jul 30 12:59:40.992674 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:40.988245 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-228r4" event={"ID":"5c1ccafd-7384-4569-b270-4b6083b23ca9","Type":"ContainerDied","Data":"a2bed2aaa8c4d7da560f4b56a27ab6e7e769a8853a3ba22bfe9c634f12a7e573"} Jul 30 12:59:40.992674 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:40.988295 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zkflm" Jul 30 12:59:40.992674 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:40.988827 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zkflm" Jul 30 12:59:41.009794 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:41.009759 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zkflm" Jul 30 12:59:41.742676 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:41.742644 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xzq9h"] Jul 30 12:59:41.743093 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:41.742807 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xzq9h" Jul 30 12:59:41.743093 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:41.742923 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xzq9h" podUID="e4027c79-c8b8-4800-9db1-843170f52290" Jul 30 12:59:41.746684 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:41.746643 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8vppx"] Jul 30 12:59:41.746899 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:41.746779 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vppx" Jul 30 12:59:41.746899 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:41.746879 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vppx" podUID="24802bd2-a87c-440d-8ce9-1ef4780224d4" Jul 30 12:59:41.747214 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:41.747192 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mrfm9"] Jul 30 12:59:41.747305 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:41.747293 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrfm9" Jul 30 12:59:41.747477 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:41.747394 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrfm9" podUID="b4467d9b-3531-4231-8fa2-278fec9b2f6d" Jul 30 12:59:42.992708 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:42.992670 2579 generic.go:356] "Generic (PLEG): container finished" podID="5c1ccafd-7384-4569-b270-4b6083b23ca9" containerID="8c2723b322de669e91414c320e40bcc9762ba1b25f6748dc31cac27c6fa49fe3" exitCode=0 Jul 30 12:59:42.993095 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:42.992766 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-228r4" event={"ID":"5c1ccafd-7384-4569-b270-4b6083b23ca9","Type":"ContainerDied","Data":"8c2723b322de669e91414c320e40bcc9762ba1b25f6748dc31cac27c6fa49fe3"} Jul 30 12:59:43.701668 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:43.701502 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vppx" Jul 30 12:59:43.701783 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:43.701558 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xzq9h" Jul 30 12:59:43.701783 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:43.701760 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vppx" podUID="24802bd2-a87c-440d-8ce9-1ef4780224d4" Jul 30 12:59:43.701873 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:43.701558 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrfm9" Jul 30 12:59:43.701912 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:43.701810 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xzq9h" podUID="e4027c79-c8b8-4800-9db1-843170f52290" Jul 30 12:59:43.701946 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:43.701912 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrfm9" podUID="b4467d9b-3531-4231-8fa2-278fec9b2f6d" Jul 30 12:59:44.999758 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:44.999722 2579 generic.go:356] "Generic (PLEG): container finished" podID="5c1ccafd-7384-4569-b270-4b6083b23ca9" containerID="168d2bf383e288d643a509f4ad5f04badf129b909d2d4943c1e0c5eb797d152d" exitCode=0 Jul 30 12:59:45.000450 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:44.999775 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-228r4" event={"ID":"5c1ccafd-7384-4569-b270-4b6083b23ca9","Type":"ContainerDied","Data":"168d2bf383e288d643a509f4ad5f04badf129b909d2d4943c1e0c5eb797d152d"} Jul 30 12:59:45.701922 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:45.701888 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xzq9h" Jul 30 12:59:45.702114 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:45.701903 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrfm9" Jul 30 12:59:45.702114 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:45.702018 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vppx" Jul 30 12:59:45.702114 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:45.702013 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xzq9h" podUID="e4027c79-c8b8-4800-9db1-843170f52290" Jul 30 12:59:45.702265 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:45.702141 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrfm9" podUID="b4467d9b-3531-4231-8fa2-278fec9b2f6d" Jul 30 12:59:45.702265 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:45.702211 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vppx" podUID="24802bd2-a87c-440d-8ce9-1ef4780224d4" Jul 30 12:59:46.444165 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:46.444128 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e4027c79-c8b8-4800-9db1-843170f52290-original-pull-secret\") pod \"global-pull-secret-syncer-xzq9h\" (UID: \"e4027c79-c8b8-4800-9db1-843170f52290\") " pod="kube-system/global-pull-secret-syncer-xzq9h" Jul 30 12:59:46.444760 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:46.444188 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2c2lf\" (UniqueName: \"kubernetes.io/projected/24802bd2-a87c-440d-8ce9-1ef4780224d4-kube-api-access-2c2lf\") pod \"network-check-target-8vppx\" (UID: \"24802bd2-a87c-440d-8ce9-1ef4780224d4\") " pod="openshift-network-diagnostics/network-check-target-8vppx" Jul 30 12:59:46.444760 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:46.444217 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4467d9b-3531-4231-8fa2-278fec9b2f6d-metrics-certs\") pod \"network-metrics-daemon-mrfm9\" (UID: \"b4467d9b-3531-4231-8fa2-278fec9b2f6d\") " pod="openshift-multus/network-metrics-daemon-mrfm9" Jul 30 12:59:46.444760 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:46.444287 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 30 12:59:46.444760 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:46.444319 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 30 12:59:46.444760 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:46.444355 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4027c79-c8b8-4800-9db1-843170f52290-original-pull-secret podName:e4027c79-c8b8-4800-9db1-843170f52290 nodeName:}" failed. No retries permitted until 2026-07-30 13:00:18.444338981 +0000 UTC m=+66.275805094 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e4027c79-c8b8-4800-9db1-843170f52290-original-pull-secret") pod "global-pull-secret-syncer-xzq9h" (UID: "e4027c79-c8b8-4800-9db1-843170f52290") : object "kube-system"/"original-pull-secret" not registered Jul 30 12:59:46.444760 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:46.444360 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 30 12:59:46.444760 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:46.444376 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4467d9b-3531-4231-8fa2-278fec9b2f6d-metrics-certs podName:b4467d9b-3531-4231-8fa2-278fec9b2f6d nodeName:}" failed. No retries permitted until 2026-07-30 13:00:18.444365604 +0000 UTC m=+66.275831710 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b4467d9b-3531-4231-8fa2-278fec9b2f6d-metrics-certs") pod "network-metrics-daemon-mrfm9" (UID: "b4467d9b-3531-4231-8fa2-278fec9b2f6d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 30 12:59:46.444760 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:46.444378 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 30 12:59:46.444760 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:46.444394 2579 projected.go:196] Error preparing data for projected volume kube-api-access-2c2lf for pod openshift-network-diagnostics/network-check-target-8vppx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 30 12:59:46.444760 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:46.444436 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/24802bd2-a87c-440d-8ce9-1ef4780224d4-kube-api-access-2c2lf podName:24802bd2-a87c-440d-8ce9-1ef4780224d4 nodeName:}" failed. No retries permitted until 2026-07-30 13:00:18.444426724 +0000 UTC m=+66.275892826 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-2c2lf" (UniqueName: "kubernetes.io/projected/24802bd2-a87c-440d-8ce9-1ef4780224d4-kube-api-access-2c2lf") pod "network-check-target-8vppx" (UID: "24802bd2-a87c-440d-8ce9-1ef4780224d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 30 12:59:47.035362 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:47.035285 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-230.ec2.internal" event="NodeReady" Jul 30 12:59:47.035533 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:47.035455 2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 30 12:59:47.083589 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:47.083255 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7b957f76f4-w85x4"] Jul 30 12:59:47.087796 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:47.087760 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b957f76f4-w85x4" Jul 30 12:59:47.090527 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:47.090492 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 30 12:59:47.091144 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:47.091123 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 30 12:59:47.091253 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:47.091154 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-c6xmw\"" Jul 30 12:59:47.091493 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:47.091468 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 30 12:59:47.098093 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:47.098073 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 30 12:59:47.103087 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:47.103061 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-598js"] Jul 30 12:59:47.107736 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:47.107715 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7b957f76f4-w85x4"] Jul 30 12:59:47.107849 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:47.107752 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-xzr5s"] Jul 30 12:59:47.107909 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:47.107850 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-598js" Jul 30 12:59:47.111803 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:47.111784 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xzr5s" Jul 30 12:59:47.112484 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:47.112325 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 30 12:59:47.112484 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:47.112370 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lv78x\"" Jul 30 12:59:47.112843 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:47.112824 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 30 12:59:47.115007 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:47.114982 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 30 12:59:47.115124 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:47.115036 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 30 12:59:47.115741 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:47.115497 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 30 12:59:47.116452 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:47.116410 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-r52zx\"" Jul 30 12:59:47.122447 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:47.122338 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-598js"] Jul 30 12:59:47.126400 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:47.126375 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xzr5s"] Jul 30 12:59:47.246398 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:47.246360 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 12:59:47.250189 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:47.250164 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a34ce5ce-94cf-4ab0-923d-c12612130e0a-tmp-dir\") pod \"dns-default-598js\" (UID: \"a34ce5ce-94cf-4ab0-923d-c12612130e0a\") " pod="openshift-dns/dns-default-598js" Jul 30 12:59:47.250337 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:47.250196 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/16c04b61-06b6-45f8-a4c6-cb1e1652aa0c-bound-sa-token\") pod \"image-registry-7b957f76f4-w85x4\" (UID: \"16c04b61-06b6-45f8-a4c6-cb1e1652aa0c\") " pod="openshift-image-registry/image-registry-7b957f76f4-w85x4" Jul 30 12:59:47.250337 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:47.250221 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p78zt\" (UniqueName: \"kubernetes.io/projected/a34ce5ce-94cf-4ab0-923d-c12612130e0a-kube-api-access-p78zt\") pod \"dns-default-598js\" (UID: \"a34ce5ce-94cf-4ab0-923d-c12612130e0a\") " pod="openshift-dns/dns-default-598js" Jul 30 12:59:47.250337 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:47.250267 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4c0375ad-3873-408c-95c6-4c826bb4629a-cert\") pod \"ingress-canary-xzr5s\" (UID: \"4c0375ad-3873-408c-95c6-4c826bb4629a\") " pod="openshift-ingress-canary/ingress-canary-xzr5s" Jul 30 12:59:47.250337 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:47.250283 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/16c04b61-06b6-45f8-a4c6-cb1e1652aa0c-installation-pull-secrets\") pod \"image-registry-7b957f76f4-w85x4\" (UID: \"16c04b61-06b6-45f8-a4c6-cb1e1652aa0c\") " pod="openshift-image-registry/image-registry-7b957f76f4-w85x4" Jul 30 12:59:47.250337 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:47.250326 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a34ce5ce-94cf-4ab0-923d-c12612130e0a-metrics-tls\") pod \"dns-default-598js\" (UID: \"a34ce5ce-94cf-4ab0-923d-c12612130e0a\") " pod="openshift-dns/dns-default-598js" Jul 30 12:59:47.250623 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:47.250349 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/16c04b61-06b6-45f8-a4c6-cb1e1652aa0c-image-registry-private-configuration\") pod \"image-registry-7b957f76f4-w85x4\" (UID: \"16c04b61-06b6-45f8-a4c6-cb1e1652aa0c\") " pod="openshift-image-registry/image-registry-7b957f76f4-w85x4" Jul 30 12:59:47.250623 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:47.250365 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/16c04b61-06b6-45f8-a4c6-cb1e1652aa0c-registry-tls\") pod \"image-registry-7b957f76f4-w85x4\" (UID: \"16c04b61-06b6-45f8-a4c6-cb1e1652aa0c\") " pod="openshift-image-registry/image-registry-7b957f76f4-w85x4" Jul 30 12:59:47.250623 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:47.250385 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/16c04b61-06b6-45f8-a4c6-cb1e1652aa0c-ca-trust-extracted\") pod \"image-registry-7b957f76f4-w85x4\" (UID: \"16c04b61-06b6-45f8-a4c6-cb1e1652aa0c\") " pod="openshift-image-registry/image-registry-7b957f76f4-w85x4" Jul 30 12:59:47.250623 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:47.250441 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/16c04b61-06b6-45f8-a4c6-cb1e1652aa0c-registry-certificates\") pod \"image-registry-7b957f76f4-w85x4\" (UID: \"16c04b61-06b6-45f8-a4c6-cb1e1652aa0c\") " pod="openshift-image-registry/image-registry-7b957f76f4-w85x4" Jul 30 12:59:47.250623 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:47.250464 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/16c04b61-06b6-45f8-a4c6-cb1e1652aa0c-trusted-ca\") pod \"image-registry-7b957f76f4-w85x4\" (UID: \"16c04b61-06b6-45f8-a4c6-cb1e1652aa0c\") " pod="openshift-image-registry/image-registry-7b957f76f4-w85x4" Jul 30 12:59:47.250623 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:47.250485 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a34ce5ce-94cf-4ab0-923d-c12612130e0a-config-volume\") pod \"dns-default-598js\" (UID: \"a34ce5ce-94cf-4ab0-923d-c12612130e0a\") " pod="openshift-dns/dns-default-598js" Jul 30 12:59:47.250623 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:47.250509 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znph7\" (UniqueName: \"kubernetes.io/projected/16c04b61-06b6-45f8-a4c6-cb1e1652aa0c-kube-api-access-znph7\") pod \"image-registry-7b957f76f4-w85x4\" (UID: \"16c04b61-06b6-45f8-a4c6-cb1e1652aa0c\") " pod="openshift-image-registry/image-registry-7b957f76f4-w85x4" Jul 30 12:59:47.250623 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:47.250552 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vjmp\" (UniqueName: \"kubernetes.io/projected/4c0375ad-3873-408c-95c6-4c826bb4629a-kube-api-access-6vjmp\") pod \"ingress-canary-xzr5s\" (UID: \"4c0375ad-3873-408c-95c6-4c826bb4629a\") " pod="openshift-ingress-canary/ingress-canary-xzr5s" Jul 30 12:59:47.348799 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:47.348718 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 12:59:47.351695 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:47.351670 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znph7\" (UniqueName: \"kubernetes.io/projected/16c04b61-06b6-45f8-a4c6-cb1e1652aa0c-kube-api-access-znph7\") pod \"image-registry-7b957f76f4-w85x4\" (UID: \"16c04b61-06b6-45f8-a4c6-cb1e1652aa0c\") " pod="openshift-image-registry/image-registry-7b957f76f4-w85x4" Jul 30 12:59:47.351834 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:47.351740 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vjmp\" (UniqueName: \"kubernetes.io/projected/4c0375ad-3873-408c-95c6-4c826bb4629a-kube-api-access-6vjmp\") pod \"ingress-canary-xzr5s\" (UID: \"4c0375ad-3873-408c-95c6-4c826bb4629a\") " pod="openshift-ingress-canary/ingress-canary-xzr5s" Jul 30 12:59:47.351834 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:47.351763 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a34ce5ce-94cf-4ab0-923d-c12612130e0a-tmp-dir\") pod \"dns-default-598js\" (UID: \"a34ce5ce-94cf-4ab0-923d-c12612130e0a\") " pod="openshift-dns/dns-default-598js" Jul 30 12:59:47.351834 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:47.351783 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/16c04b61-06b6-45f8-a4c6-cb1e1652aa0c-bound-sa-token\") pod \"image-registry-7b957f76f4-w85x4\" (UID: \"16c04b61-06b6-45f8-a4c6-cb1e1652aa0c\") " pod="openshift-image-registry/image-registry-7b957f76f4-w85x4" Jul 30 12:59:47.351834 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:47.351797 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p78zt\" (UniqueName: \"kubernetes.io/projected/a34ce5ce-94cf-4ab0-923d-c12612130e0a-kube-api-access-p78zt\") pod \"dns-default-598js\" (UID: \"a34ce5ce-94cf-4ab0-923d-c12612130e0a\") " pod="openshift-dns/dns-default-598js" Jul 30 12:59:47.351834 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:47.351828 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4c0375ad-3873-408c-95c6-4c826bb4629a-cert\") pod \"ingress-canary-xzr5s\" (UID: \"4c0375ad-3873-408c-95c6-4c826bb4629a\") " pod="openshift-ingress-canary/ingress-canary-xzr5s" Jul 30 12:59:47.352082 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:47.351850 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/16c04b61-06b6-45f8-a4c6-cb1e1652aa0c-installation-pull-secrets\") pod \"image-registry-7b957f76f4-w85x4\" (UID: \"16c04b61-06b6-45f8-a4c6-cb1e1652aa0c\") " pod="openshift-image-registry/image-registry-7b957f76f4-w85x4" Jul 30 12:59:47.352082 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:47.352018 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a34ce5ce-94cf-4ab0-923d-c12612130e0a-metrics-tls\") pod \"dns-default-598js\" (UID: \"a34ce5ce-94cf-4ab0-923d-c12612130e0a\") " pod="openshift-dns/dns-default-598js" Jul 30 12:59:47.352082 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:47.352071 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/16c04b61-06b6-45f8-a4c6-cb1e1652aa0c-image-registry-private-configuration\") pod \"image-registry-7b957f76f4-w85x4\" (UID: \"16c04b61-06b6-45f8-a4c6-cb1e1652aa0c\") " pod="openshift-image-registry/image-registry-7b957f76f4-w85x4" Jul 30 12:59:47.352228 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:47.352099 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/16c04b61-06b6-45f8-a4c6-cb1e1652aa0c-registry-tls\") pod \"image-registry-7b957f76f4-w85x4\" (UID: \"16c04b61-06b6-45f8-a4c6-cb1e1652aa0c\") " pod="openshift-image-registry/image-registry-7b957f76f4-w85x4" Jul 30 12:59:47.352228 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:47.352123 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/16c04b61-06b6-45f8-a4c6-cb1e1652aa0c-ca-trust-extracted\") pod \"image-registry-7b957f76f4-w85x4\" (UID: \"16c04b61-06b6-45f8-a4c6-cb1e1652aa0c\") " pod="openshift-image-registry/image-registry-7b957f76f4-w85x4" Jul 30 12:59:47.352228 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:47.352147 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/16c04b61-06b6-45f8-a4c6-cb1e1652aa0c-registry-certificates\") pod \"image-registry-7b957f76f4-w85x4\" (UID: \"16c04b61-06b6-45f8-a4c6-cb1e1652aa0c\") " pod="openshift-image-registry/image-registry-7b957f76f4-w85x4" Jul 30 12:59:47.352228 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:47.352172 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/16c04b61-06b6-45f8-a4c6-cb1e1652aa0c-trusted-ca\") pod \"image-registry-7b957f76f4-w85x4\" (UID: \"16c04b61-06b6-45f8-a4c6-cb1e1652aa0c\") " pod="openshift-image-registry/image-registry-7b957f76f4-w85x4" Jul 30 12:59:47.352228 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:47.352191 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a34ce5ce-94cf-4ab0-923d-c12612130e0a-config-volume\") pod \"dns-default-598js\" (UID: \"a34ce5ce-94cf-4ab0-923d-c12612130e0a\") " pod="openshift-dns/dns-default-598js" Jul 30 12:59:47.352228 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:47.352198 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a34ce5ce-94cf-4ab0-923d-c12612130e0a-tmp-dir\") pod \"dns-default-598js\" (UID: \"a34ce5ce-94cf-4ab0-923d-c12612130e0a\") " pod="openshift-dns/dns-default-598js" Jul 30 12:59:47.352622 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:47.352310 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 30 12:59:47.352622 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:47.352392 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a34ce5ce-94cf-4ab0-923d-c12612130e0a-metrics-tls podName:a34ce5ce-94cf-4ab0-923d-c12612130e0a nodeName:}" failed. No retries permitted until 2026-07-30 12:59:47.852368131 +0000 UTC m=+35.683834242 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a34ce5ce-94cf-4ab0-923d-c12612130e0a-metrics-tls") pod "dns-default-598js" (UID: "a34ce5ce-94cf-4ab0-923d-c12612130e0a") : secret "dns-default-metrics-tls" not found Jul 30 12:59:47.352622 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:47.352504 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 30 12:59:47.352622 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:47.352520 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b957f76f4-w85x4: secret "image-registry-tls" not found Jul 30 12:59:47.352622 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:47.352578 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/16c04b61-06b6-45f8-a4c6-cb1e1652aa0c-registry-tls podName:16c04b61-06b6-45f8-a4c6-cb1e1652aa0c nodeName:}" failed. No retries permitted until 2026-07-30 12:59:47.852560608 +0000 UTC m=+35.684026732 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/16c04b61-06b6-45f8-a4c6-cb1e1652aa0c-registry-tls") pod "image-registry-7b957f76f4-w85x4" (UID: "16c04b61-06b6-45f8-a4c6-cb1e1652aa0c") : secret "image-registry-tls" not found Jul 30 12:59:47.352877 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:47.352781 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a34ce5ce-94cf-4ab0-923d-c12612130e0a-config-volume\") pod \"dns-default-598js\" (UID: \"a34ce5ce-94cf-4ab0-923d-c12612130e0a\") " pod="openshift-dns/dns-default-598js" Jul 30 12:59:47.352988 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:47.352874 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/16c04b61-06b6-45f8-a4c6-cb1e1652aa0c-ca-trust-extracted\") pod \"image-registry-7b957f76f4-w85x4\" (UID: \"16c04b61-06b6-45f8-a4c6-cb1e1652aa0c\") " pod="openshift-image-registry/image-registry-7b957f76f4-w85x4" Jul 30 12:59:47.353042 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:47.353010 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/16c04b61-06b6-45f8-a4c6-cb1e1652aa0c-registry-certificates\") pod \"image-registry-7b957f76f4-w85x4\" (UID: \"16c04b61-06b6-45f8-a4c6-cb1e1652aa0c\") " pod="openshift-image-registry/image-registry-7b957f76f4-w85x4" Jul 30 12:59:47.353562 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:47.353541 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/16c04b61-06b6-45f8-a4c6-cb1e1652aa0c-trusted-ca\") pod \"image-registry-7b957f76f4-w85x4\" (UID: \"16c04b61-06b6-45f8-a4c6-cb1e1652aa0c\") " pod="openshift-image-registry/image-registry-7b957f76f4-w85x4" Jul 30 12:59:47.356728 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:47.356701 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/16c04b61-06b6-45f8-a4c6-cb1e1652aa0c-installation-pull-secrets\") pod \"image-registry-7b957f76f4-w85x4\" (UID: \"16c04b61-06b6-45f8-a4c6-cb1e1652aa0c\") " pod="openshift-image-registry/image-registry-7b957f76f4-w85x4" Jul 30 12:59:47.356836 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:47.356707 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/16c04b61-06b6-45f8-a4c6-cb1e1652aa0c-image-registry-private-configuration\") pod \"image-registry-7b957f76f4-w85x4\" (UID: \"16c04b61-06b6-45f8-a4c6-cb1e1652aa0c\") " pod="openshift-image-registry/image-registry-7b957f76f4-w85x4" Jul 30 12:59:47.356836 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:47.356784 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4c0375ad-3873-408c-95c6-4c826bb4629a-cert\") pod \"ingress-canary-xzr5s\" (UID: \"4c0375ad-3873-408c-95c6-4c826bb4629a\") " pod="openshift-ingress-canary/ingress-canary-xzr5s" Jul 30 12:59:47.363143 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:47.363098 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-znph7\" (UniqueName: \"kubernetes.io/projected/16c04b61-06b6-45f8-a4c6-cb1e1652aa0c-kube-api-access-znph7\") pod \"image-registry-7b957f76f4-w85x4\" (UID: \"16c04b61-06b6-45f8-a4c6-cb1e1652aa0c\") " pod="openshift-image-registry/image-registry-7b957f76f4-w85x4" Jul 30 12:59:47.366078 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:47.366036 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/16c04b61-06b6-45f8-a4c6-cb1e1652aa0c-bound-sa-token\") pod \"image-registry-7b957f76f4-w85x4\" (UID: \"16c04b61-06b6-45f8-a4c6-cb1e1652aa0c\") " pod="openshift-image-registry/image-registry-7b957f76f4-w85x4" Jul 30 12:59:47.366170 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:47.366075 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p78zt\" (UniqueName: \"kubernetes.io/projected/a34ce5ce-94cf-4ab0-923d-c12612130e0a-kube-api-access-p78zt\") pod \"dns-default-598js\" (UID: \"a34ce5ce-94cf-4ab0-923d-c12612130e0a\") " pod="openshift-dns/dns-default-598js" Jul 30 12:59:47.368229 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:47.368208 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vjmp\" (UniqueName: \"kubernetes.io/projected/4c0375ad-3873-408c-95c6-4c826bb4629a-kube-api-access-6vjmp\") pod \"ingress-canary-xzr5s\" (UID: \"4c0375ad-3873-408c-95c6-4c826bb4629a\") " pod="openshift-ingress-canary/ingress-canary-xzr5s" Jul 30 12:59:47.427893 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:47.427861 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xzr5s" Jul 30 12:59:47.701776 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:47.701747 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vppx" Jul 30 12:59:47.702478 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:47.701752 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrfm9" Jul 30 12:59:47.702478 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:47.701752 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xzq9h" Jul 30 12:59:47.704946 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:47.704925 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 30 12:59:47.705116 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:47.705098 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cq62z\"" Jul 30 12:59:47.705188 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:47.705167 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 30 12:59:47.705309 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:47.705289 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 30 12:59:47.705407 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:47.705393 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-v4mfl\"" Jul 30 12:59:47.706067 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:47.706049 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 30 12:59:47.856604 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:47.856569 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a34ce5ce-94cf-4ab0-923d-c12612130e0a-metrics-tls\") pod \"dns-default-598js\" (UID: \"a34ce5ce-94cf-4ab0-923d-c12612130e0a\") " pod="openshift-dns/dns-default-598js" Jul 30 12:59:47.856763 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:47.856626 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/16c04b61-06b6-45f8-a4c6-cb1e1652aa0c-registry-tls\") pod \"image-registry-7b957f76f4-w85x4\" (UID: \"16c04b61-06b6-45f8-a4c6-cb1e1652aa0c\") " pod="openshift-image-registry/image-registry-7b957f76f4-w85x4" Jul 30 12:59:47.856763 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:47.856748 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 30 12:59:47.856880 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:47.856803 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 30 12:59:47.856880 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:47.856819 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b957f76f4-w85x4: secret "image-registry-tls" not found Jul 30 12:59:47.856880 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:47.856810 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a34ce5ce-94cf-4ab0-923d-c12612130e0a-metrics-tls podName:a34ce5ce-94cf-4ab0-923d-c12612130e0a nodeName:}" failed. No retries permitted until 2026-07-30 12:59:48.856791304 +0000 UTC m=+36.688257407 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a34ce5ce-94cf-4ab0-923d-c12612130e0a-metrics-tls") pod "dns-default-598js" (UID: "a34ce5ce-94cf-4ab0-923d-c12612130e0a") : secret "dns-default-metrics-tls" not found Jul 30 12:59:47.857010 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:47.856898 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/16c04b61-06b6-45f8-a4c6-cb1e1652aa0c-registry-tls podName:16c04b61-06b6-45f8-a4c6-cb1e1652aa0c nodeName:}" failed. No retries permitted until 2026-07-30 12:59:48.85687896 +0000 UTC m=+36.688345070 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/16c04b61-06b6-45f8-a4c6-cb1e1652aa0c-registry-tls") pod "image-registry-7b957f76f4-w85x4" (UID: "16c04b61-06b6-45f8-a4c6-cb1e1652aa0c") : secret "image-registry-tls" not found Jul 30 12:59:48.863643 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:48.863602 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a34ce5ce-94cf-4ab0-923d-c12612130e0a-metrics-tls\") pod \"dns-default-598js\" (UID: \"a34ce5ce-94cf-4ab0-923d-c12612130e0a\") " pod="openshift-dns/dns-default-598js" Jul 30 12:59:48.863643 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:48.863649 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/16c04b61-06b6-45f8-a4c6-cb1e1652aa0c-registry-tls\") pod \"image-registry-7b957f76f4-w85x4\" (UID: \"16c04b61-06b6-45f8-a4c6-cb1e1652aa0c\") " pod="openshift-image-registry/image-registry-7b957f76f4-w85x4" Jul 30 12:59:48.864106 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:48.863746 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 30 12:59:48.864106 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:48.863776 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 30 12:59:48.864106 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:48.863789 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b957f76f4-w85x4: secret "image-registry-tls" not found Jul 30 12:59:48.864106 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:48.863824 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a34ce5ce-94cf-4ab0-923d-c12612130e0a-metrics-tls podName:a34ce5ce-94cf-4ab0-923d-c12612130e0a nodeName:}" failed. No retries permitted until 2026-07-30 12:59:50.863804461 +0000 UTC m=+38.695270565 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a34ce5ce-94cf-4ab0-923d-c12612130e0a-metrics-tls") pod "dns-default-598js" (UID: "a34ce5ce-94cf-4ab0-923d-c12612130e0a") : secret "dns-default-metrics-tls" not found Jul 30 12:59:48.864106 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:48.863844 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/16c04b61-06b6-45f8-a4c6-cb1e1652aa0c-registry-tls podName:16c04b61-06b6-45f8-a4c6-cb1e1652aa0c nodeName:}" failed. No retries permitted until 2026-07-30 12:59:50.863834645 +0000 UTC m=+38.695300748 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/16c04b61-06b6-45f8-a4c6-cb1e1652aa0c-registry-tls") pod "image-registry-7b957f76f4-w85x4" (UID: "16c04b61-06b6-45f8-a4c6-cb1e1652aa0c") : secret "image-registry-tls" not found Jul 30 12:59:49.058134 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:49.058100 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xzr5s"] Jul 30 12:59:49.061444 ip-10-0-133-230 kubenswrapper[2579]: W0730 12:59:49.061395 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c0375ad_3873_408c_95c6_4c826bb4629a.slice/crio-98fbf0844184bb42f1c3e824d154a32e7c2286059470fd241fef4744a6e1f873 WatchSource:0}: Error finding container 98fbf0844184bb42f1c3e824d154a32e7c2286059470fd241fef4744a6e1f873: Status 404 returned error can't find the container with id 98fbf0844184bb42f1c3e824d154a32e7c2286059470fd241fef4744a6e1f873 Jul 30 12:59:50.017878 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:50.017847 2579 generic.go:356] "Generic (PLEG): container finished" podID="5c1ccafd-7384-4569-b270-4b6083b23ca9" containerID="9e177ca3567e174f1149a28df3460483af7e803d3b1805b788dd5926e1f337ec" exitCode=0 Jul 30 12:59:50.018268 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:50.017931 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-228r4" event={"ID":"5c1ccafd-7384-4569-b270-4b6083b23ca9","Type":"ContainerDied","Data":"9e177ca3567e174f1149a28df3460483af7e803d3b1805b788dd5926e1f337ec"} Jul 30 12:59:50.019320 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:50.019296 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xzr5s" event={"ID":"4c0375ad-3873-408c-95c6-4c826bb4629a","Type":"ContainerStarted","Data":"98fbf0844184bb42f1c3e824d154a32e7c2286059470fd241fef4744a6e1f873"} Jul 30 12:59:50.878176 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:50.877989 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a34ce5ce-94cf-4ab0-923d-c12612130e0a-metrics-tls\") pod \"dns-default-598js\" (UID: \"a34ce5ce-94cf-4ab0-923d-c12612130e0a\") " pod="openshift-dns/dns-default-598js" Jul 30 12:59:50.878176 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:50.878161 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 30 12:59:50.878396 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:50.878194 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/16c04b61-06b6-45f8-a4c6-cb1e1652aa0c-registry-tls\") pod \"image-registry-7b957f76f4-w85x4\" (UID: \"16c04b61-06b6-45f8-a4c6-cb1e1652aa0c\") " pod="openshift-image-registry/image-registry-7b957f76f4-w85x4" Jul 30 12:59:50.878396 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:50.878235 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a34ce5ce-94cf-4ab0-923d-c12612130e0a-metrics-tls podName:a34ce5ce-94cf-4ab0-923d-c12612130e0a nodeName:}" failed. No retries permitted until 2026-07-30 12:59:54.878215111 +0000 UTC m=+42.709681230 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a34ce5ce-94cf-4ab0-923d-c12612130e0a-metrics-tls") pod "dns-default-598js" (UID: "a34ce5ce-94cf-4ab0-923d-c12612130e0a") : secret "dns-default-metrics-tls" not found Jul 30 12:59:50.878396 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:50.878286 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 30 12:59:50.878396 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:50.878299 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b957f76f4-w85x4: secret "image-registry-tls" not found Jul 30 12:59:50.878396 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:50.878344 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/16c04b61-06b6-45f8-a4c6-cb1e1652aa0c-registry-tls podName:16c04b61-06b6-45f8-a4c6-cb1e1652aa0c nodeName:}" failed. No retries permitted until 2026-07-30 12:59:54.878331554 +0000 UTC m=+42.709797660 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/16c04b61-06b6-45f8-a4c6-cb1e1652aa0c-registry-tls") pod "image-registry-7b957f76f4-w85x4" (UID: "16c04b61-06b6-45f8-a4c6-cb1e1652aa0c") : secret "image-registry-tls" not found Jul 30 12:59:51.025703 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:51.025672 2579 generic.go:356] "Generic (PLEG): container finished" podID="5c1ccafd-7384-4569-b270-4b6083b23ca9" containerID="b0949cc8fd10c4bfccfc8ede98eff1bdfa70c9031a34016fe1134e83fa7d51d5" exitCode=0 Jul 30 12:59:51.026114 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:51.025729 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-228r4" event={"ID":"5c1ccafd-7384-4569-b270-4b6083b23ca9","Type":"ContainerDied","Data":"b0949cc8fd10c4bfccfc8ede98eff1bdfa70c9031a34016fe1134e83fa7d51d5"} Jul 30 12:59:51.958038 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:51.958012 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 12:59:52.019494 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:52.019468 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 12:59:52.028949 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:52.028922 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xzr5s" event={"ID":"4c0375ad-3873-408c-95c6-4c826bb4629a","Type":"ContainerStarted","Data":"e3155990289b88066f654e63528511448682bbdc83ba9880de21b562c0a3bd30"} Jul 30 12:59:52.032222 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:52.032202 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-228r4" event={"ID":"5c1ccafd-7384-4569-b270-4b6083b23ca9","Type":"ContainerStarted","Data":"8815c58c85a877f9302b1278ff6a3aa03b37bdc1c7056852ca05766165dd1de9"} Jul 30 12:59:52.062701 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:52.062430 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-228r4" podStartSLOduration=9.401951158 podStartE2EDuration="39.062392226s" totalImagesPullingTime="29.660441068s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 12:59:13 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 12:59:52.061807479 +0000 UTC m=+39.893273617" watchObservedRunningTime="2026-07-30 12:59:52.062392226 +0000 UTC m=+39.893858352" Jul 30 12:59:52.181637 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:52.181590 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 12:59:52.281491 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:52.281391 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 12:59:52.338436 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:52.338382 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 12:59:53.054779 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:53.054730 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-xzr5s" podStartSLOduration=3.186994897 podStartE2EDuration="6.054707336s" totalImagesPullingTime="2.867712439s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 12:59:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 12:59:53.053542216 +0000 UTC m=+40.885008357" watchObservedRunningTime="2026-07-30 12:59:53.054707336 +0000 UTC m=+40.886173457" Jul 30 12:59:54.031703 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:54.031662 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 12:59:54.102298 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:54.102258 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 12:59:54.914763 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:54.914727 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a34ce5ce-94cf-4ab0-923d-c12612130e0a-metrics-tls\") pod \"dns-default-598js\" (UID: \"a34ce5ce-94cf-4ab0-923d-c12612130e0a\") " pod="openshift-dns/dns-default-598js" Jul 30 12:59:54.914910 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:54.914772 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/16c04b61-06b6-45f8-a4c6-cb1e1652aa0c-registry-tls\") pod \"image-registry-7b957f76f4-w85x4\" (UID: \"16c04b61-06b6-45f8-a4c6-cb1e1652aa0c\") " pod="openshift-image-registry/image-registry-7b957f76f4-w85x4" Jul 30 12:59:54.914910 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:54.914879 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 30 12:59:54.914910 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:54.914880 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 30 12:59:54.915024 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:54.914946 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a34ce5ce-94cf-4ab0-923d-c12612130e0a-metrics-tls podName:a34ce5ce-94cf-4ab0-923d-c12612130e0a nodeName:}" failed. No retries permitted until 2026-07-30 13:00:02.91493004 +0000 UTC m=+50.746396147 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a34ce5ce-94cf-4ab0-923d-c12612130e0a-metrics-tls") pod "dns-default-598js" (UID: "a34ce5ce-94cf-4ab0-923d-c12612130e0a") : secret "dns-default-metrics-tls" not found Jul 30 12:59:54.915024 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:54.914890 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b957f76f4-w85x4: secret "image-registry-tls" not found Jul 30 12:59:54.915024 ip-10-0-133-230 kubenswrapper[2579]: E0730 12:59:54.915024 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/16c04b61-06b6-45f8-a4c6-cb1e1652aa0c-registry-tls podName:16c04b61-06b6-45f8-a4c6-cb1e1652aa0c nodeName:}" failed. No retries permitted until 2026-07-30 13:00:02.915011459 +0000 UTC m=+50.746477563 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/16c04b61-06b6-45f8-a4c6-cb1e1652aa0c-registry-tls") pod "image-registry-7b957f76f4-w85x4" (UID: "16c04b61-06b6-45f8-a4c6-cb1e1652aa0c") : secret "image-registry-tls" not found Jul 30 12:59:55.017017 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:55.016980 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 12:59:55.106330 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:55.106289 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 12:59:55.934827 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:55.934786 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 12:59:59.468715 ip-10-0-133-230 kubenswrapper[2579]: I0730 12:59:59.468681 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:00:00.668082 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:00.667981 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:00:02.968279 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:02.968243 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/16c04b61-06b6-45f8-a4c6-cb1e1652aa0c-registry-tls\") pod \"image-registry-7b957f76f4-w85x4\" (UID: \"16c04b61-06b6-45f8-a4c6-cb1e1652aa0c\") " pod="openshift-image-registry/image-registry-7b957f76f4-w85x4" Jul 30 13:00:02.968687 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:02.968321 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a34ce5ce-94cf-4ab0-923d-c12612130e0a-metrics-tls\") pod \"dns-default-598js\" (UID: \"a34ce5ce-94cf-4ab0-923d-c12612130e0a\") " pod="openshift-dns/dns-default-598js" Jul 30 13:00:02.968687 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:00:02.968393 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 30 13:00:02.968687 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:00:02.968407 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 30 13:00:02.968687 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:00:02.968430 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b957f76f4-w85x4: secret "image-registry-tls" not found Jul 30 13:00:02.968687 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:00:02.968484 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/16c04b61-06b6-45f8-a4c6-cb1e1652aa0c-registry-tls podName:16c04b61-06b6-45f8-a4c6-cb1e1652aa0c nodeName:}" failed. No retries permitted until 2026-07-30 13:00:18.968466921 +0000 UTC m=+66.799933027 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/16c04b61-06b6-45f8-a4c6-cb1e1652aa0c-registry-tls") pod "image-registry-7b957f76f4-w85x4" (UID: "16c04b61-06b6-45f8-a4c6-cb1e1652aa0c") : secret "image-registry-tls" not found Jul 30 13:00:02.968687 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:00:02.968500 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a34ce5ce-94cf-4ab0-923d-c12612130e0a-metrics-tls podName:a34ce5ce-94cf-4ab0-923d-c12612130e0a nodeName:}" failed. No retries permitted until 2026-07-30 13:00:18.968494133 +0000 UTC m=+66.799960236 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a34ce5ce-94cf-4ab0-923d-c12612130e0a-metrics-tls") pod "dns-default-598js" (UID: "a34ce5ce-94cf-4ab0-923d-c12612130e0a") : secret "dns-default-metrics-tls" not found Jul 30 13:00:03.449163 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:03.449070 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:00:06.538895 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:06.538858 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:00:06.603720 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:06.603686 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:00:07.823773 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:07.823732 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:00:08.412630 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:08.412549 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:00:10.569602 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:10.569571 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:00:10.630805 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:10.630776 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:00:11.917560 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:11.917529 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:00:11.973490 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:11.973452 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:00:13.003219 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:13.003191 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zkflm" Jul 30 13:00:13.154944 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:13.154908 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:00:13.255095 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:13.255010 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:00:15.577598 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:15.577566 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:00:16.049530 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:16.049486 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:00:16.102214 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:16.102180 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:00:18.475058 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:18.475016 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2c2lf\" (UniqueName: \"kubernetes.io/projected/24802bd2-a87c-440d-8ce9-1ef4780224d4-kube-api-access-2c2lf\") pod \"network-check-target-8vppx\" (UID: \"24802bd2-a87c-440d-8ce9-1ef4780224d4\") " pod="openshift-network-diagnostics/network-check-target-8vppx" Jul 30 13:00:18.475058 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:18.475061 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4467d9b-3531-4231-8fa2-278fec9b2f6d-metrics-certs\") pod \"network-metrics-daemon-mrfm9\" (UID: \"b4467d9b-3531-4231-8fa2-278fec9b2f6d\") " pod="openshift-multus/network-metrics-daemon-mrfm9" Jul 30 13:00:18.475546 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:18.475090 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e4027c79-c8b8-4800-9db1-843170f52290-original-pull-secret\") pod \"global-pull-secret-syncer-xzq9h\" (UID: \"e4027c79-c8b8-4800-9db1-843170f52290\") " pod="kube-system/global-pull-secret-syncer-xzq9h" Jul 30 13:00:18.477983 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:18.477960 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 30 13:00:18.478093 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:18.478073 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 30 13:00:18.478156 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:18.478109 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 30 13:00:18.485429 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:00:18.485390 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 30 13:00:18.485541 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:00:18.485486 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4467d9b-3531-4231-8fa2-278fec9b2f6d-metrics-certs podName:b4467d9b-3531-4231-8fa2-278fec9b2f6d nodeName:}" failed. No retries permitted until 2026-07-30 13:01:22.485461557 +0000 UTC m=+130.316927661 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b4467d9b-3531-4231-8fa2-278fec9b2f6d-metrics-certs") pod "network-metrics-daemon-mrfm9" (UID: "b4467d9b-3531-4231-8fa2-278fec9b2f6d") : secret "metrics-daemon-secret" not found Jul 30 13:00:18.487781 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:18.487763 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 30 13:00:18.489266 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:18.489245 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e4027c79-c8b8-4800-9db1-843170f52290-original-pull-secret\") pod \"global-pull-secret-syncer-xzq9h\" (UID: \"e4027c79-c8b8-4800-9db1-843170f52290\") " pod="kube-system/global-pull-secret-syncer-xzq9h" Jul 30 13:00:18.498594 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:18.498570 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2c2lf\" (UniqueName: \"kubernetes.io/projected/24802bd2-a87c-440d-8ce9-1ef4780224d4-kube-api-access-2c2lf\") pod \"network-check-target-8vppx\" (UID: \"24802bd2-a87c-440d-8ce9-1ef4780224d4\") " pod="openshift-network-diagnostics/network-check-target-8vppx" Jul 30 13:00:18.615864 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:18.615830 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cq62z\"" Jul 30 13:00:18.623455 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:18.623434 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vppx" Jul 30 13:00:18.626712 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:18.626691 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xzq9h" Jul 30 13:00:18.770719 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:18.770687 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xzq9h"] Jul 30 13:00:18.774123 ip-10-0-133-230 kubenswrapper[2579]: W0730 13:00:18.774096 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4027c79_c8b8_4800_9db1_843170f52290.slice/crio-783c4d9176437d3c4935bac9e25483b85518504525f7232bc62261b172bcaec6 WatchSource:0}: Error finding container 783c4d9176437d3c4935bac9e25483b85518504525f7232bc62261b172bcaec6: Status 404 returned error can't find the container with id 783c4d9176437d3c4935bac9e25483b85518504525f7232bc62261b172bcaec6 Jul 30 13:00:18.788011 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:18.787987 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8vppx"] Jul 30 13:00:18.790987 ip-10-0-133-230 kubenswrapper[2579]: W0730 13:00:18.790964 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24802bd2_a87c_440d_8ce9_1ef4780224d4.slice/crio-d4597363225e4b2aba95e7299a37e27d557401d5aa009ced2a07d40d206778da WatchSource:0}: Error finding container d4597363225e4b2aba95e7299a37e27d557401d5aa009ced2a07d40d206778da: Status 404 returned error can't find the container with id d4597363225e4b2aba95e7299a37e27d557401d5aa009ced2a07d40d206778da Jul 30 13:00:18.980159 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:18.980075 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a34ce5ce-94cf-4ab0-923d-c12612130e0a-metrics-tls\") pod \"dns-default-598js\" (UID: \"a34ce5ce-94cf-4ab0-923d-c12612130e0a\") " pod="openshift-dns/dns-default-598js" Jul 30 13:00:18.980159 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:18.980117 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/16c04b61-06b6-45f8-a4c6-cb1e1652aa0c-registry-tls\") pod \"image-registry-7b957f76f4-w85x4\" (UID: \"16c04b61-06b6-45f8-a4c6-cb1e1652aa0c\") " pod="openshift-image-registry/image-registry-7b957f76f4-w85x4" Jul 30 13:00:18.980327 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:00:18.980229 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 30 13:00:18.980327 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:00:18.980231 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 30 13:00:18.980327 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:00:18.980297 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a34ce5ce-94cf-4ab0-923d-c12612130e0a-metrics-tls podName:a34ce5ce-94cf-4ab0-923d-c12612130e0a nodeName:}" failed. No retries permitted until 2026-07-30 13:00:50.980280822 +0000 UTC m=+98.811746930 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a34ce5ce-94cf-4ab0-923d-c12612130e0a-metrics-tls") pod "dns-default-598js" (UID: "a34ce5ce-94cf-4ab0-923d-c12612130e0a") : secret "dns-default-metrics-tls" not found Jul 30 13:00:18.980327 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:00:18.980240 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b957f76f4-w85x4: secret "image-registry-tls" not found Jul 30 13:00:18.980479 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:00:18.980360 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/16c04b61-06b6-45f8-a4c6-cb1e1652aa0c-registry-tls podName:16c04b61-06b6-45f8-a4c6-cb1e1652aa0c nodeName:}" failed. No retries permitted until 2026-07-30 13:00:50.980348508 +0000 UTC m=+98.811814614 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/16c04b61-06b6-45f8-a4c6-cb1e1652aa0c-registry-tls") pod "image-registry-7b957f76f4-w85x4" (UID: "16c04b61-06b6-45f8-a4c6-cb1e1652aa0c") : secret "image-registry-tls" not found Jul 30 13:00:19.091866 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:19.091824 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xzq9h" event={"ID":"e4027c79-c8b8-4800-9db1-843170f52290","Type":"ContainerStarted","Data":"783c4d9176437d3c4935bac9e25483b85518504525f7232bc62261b172bcaec6"} Jul 30 13:00:19.092906 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:19.092883 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8vppx" event={"ID":"24802bd2-a87c-440d-8ce9-1ef4780224d4","Type":"ContainerStarted","Data":"d4597363225e4b2aba95e7299a37e27d557401d5aa009ced2a07d40d206778da"} Jul 30 13:00:23.105756 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:23.105709 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8vppx" event={"ID":"24802bd2-a87c-440d-8ce9-1ef4780224d4","Type":"ContainerStarted","Data":"60e9648354893237c3295a2357763f96b5fb923ac7b9ac950a8c463302589d97"} Jul 30 13:00:23.106219 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:23.105876 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-8vppx" Jul 30 13:00:23.122465 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:23.122390 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-8vppx" podStartSLOduration=67.308638508 podStartE2EDuration="1m11.122375199s" totalImagesPullingTime="3.813736691s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 12:59:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:00:23.121689359 +0000 UTC m=+70.953155485" watchObservedRunningTime="2026-07-30 13:00:23.122375199 +0000 UTC m=+70.953841324" Jul 30 13:00:25.112500 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:25.112454 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xzq9h" event={"ID":"e4027c79-c8b8-4800-9db1-843170f52290","Type":"ContainerStarted","Data":"dd9e74096f037ea054a83426f75340c0aa62e9a1469e7b4afea9f1d09fe4ecb9"} Jul 30 13:00:25.128296 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:25.128249 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-xzq9h" podStartSLOduration=66.463172732 podStartE2EDuration="1m12.1282336s" totalImagesPullingTime="5.665060868s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 12:59:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:00:25.127590406 +0000 UTC m=+72.959056532" watchObservedRunningTime="2026-07-30 13:00:25.1282336 +0000 UTC m=+72.959699703" Jul 30 13:00:32.075407 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:32.075360 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:00:32.132035 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:32.132004 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:00:37.578283 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:37.578149 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:00:37.680318 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:37.680283 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:00:41.072316 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:41.072275 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-kr852"] Jul 30 13:00:41.076596 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:41.076572 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-cc2dk"] Jul 30 13:00:41.076717 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:41.076701 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-kr852" Jul 30 13:00:41.079234 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:41.079214 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-cc2dk" Jul 30 13:00:41.079352 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:41.079244 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 30 13:00:41.080457 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:41.080437 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 30 13:00:41.080546 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:41.080459 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 30 13:00:41.081863 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:41.081844 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-qskt6\"" Jul 30 13:00:41.082162 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:41.082143 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 30 13:00:41.083439 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:41.083404 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 30 13:00:41.083803 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:41.083784 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-t8q27\"" Jul 30 13:00:41.093818 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:41.093794 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-kr852"] Jul 30 13:00:41.099074 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:41.099052 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-cc2dk"] Jul 30 13:00:41.132468 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:41.132410 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cca02c0d-563c-45f0-b51c-4b26093bdf3e-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-kr852\" (UID: \"cca02c0d-563c-45f0-b51c-4b26093bdf3e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-kr852" Jul 30 13:00:41.132623 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:41.132512 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pcmr\" (UniqueName: \"kubernetes.io/projected/cca02c0d-563c-45f0-b51c-4b26093bdf3e-kube-api-access-5pcmr\") pod \"cluster-samples-operator-6748489656-kr852\" (UID: \"cca02c0d-563c-45f0-b51c-4b26093bdf3e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-kr852" Jul 30 13:00:41.132623 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:41.132534 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5c9ec6ef-6498-4094-8613-fb3a59fa4e24-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-cc2dk\" (UID: \"5c9ec6ef-6498-4094-8613-fb3a59fa4e24\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-cc2dk" Jul 30 13:00:41.132623 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:41.132554 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5c9ec6ef-6498-4094-8613-fb3a59fa4e24-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-cc2dk\" (UID: \"5c9ec6ef-6498-4094-8613-fb3a59fa4e24\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-cc2dk" Jul 30 13:00:41.184440 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:41.184392 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-57f58cdc8c-xn7bm"] Jul 30 13:00:41.187400 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:41.187377 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-57f58cdc8c-xn7bm" Jul 30 13:00:41.191514 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:41.191485 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 30 13:00:41.191680 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:41.191630 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 30 13:00:41.191680 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:41.191664 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 30 13:00:41.191798 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:41.191725 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 30 13:00:41.191798 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:41.191730 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 30 13:00:41.191903 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:41.191884 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-sdt76\"" Jul 30 13:00:41.192028 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:41.192010 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 30 13:00:41.201302 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:41.201281 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-57f58cdc8c-xn7bm"] Jul 30 13:00:41.233676 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:41.233649 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pcmr\" (UniqueName: \"kubernetes.io/projected/cca02c0d-563c-45f0-b51c-4b26093bdf3e-kube-api-access-5pcmr\") pod \"cluster-samples-operator-6748489656-kr852\" (UID: \"cca02c0d-563c-45f0-b51c-4b26093bdf3e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-kr852" Jul 30 13:00:41.233807 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:41.233682 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5c9ec6ef-6498-4094-8613-fb3a59fa4e24-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-cc2dk\" (UID: \"5c9ec6ef-6498-4094-8613-fb3a59fa4e24\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-cc2dk" Jul 30 13:00:41.233807 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:41.233703 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5c9ec6ef-6498-4094-8613-fb3a59fa4e24-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-cc2dk\" (UID: \"5c9ec6ef-6498-4094-8613-fb3a59fa4e24\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-cc2dk" Jul 30 13:00:41.233807 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:00:41.233790 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 30 13:00:41.233902 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:41.233846 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5703055a-5a1f-4546-bb90-1ca9d22e0933-metrics-certs\") pod \"router-default-57f58cdc8c-xn7bm\" (UID: \"5703055a-5a1f-4546-bb90-1ca9d22e0933\") " pod="openshift-ingress/router-default-57f58cdc8c-xn7bm" Jul 30 13:00:41.233902 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:00:41.233863 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c9ec6ef-6498-4094-8613-fb3a59fa4e24-networking-console-plugin-cert podName:5c9ec6ef-6498-4094-8613-fb3a59fa4e24 nodeName:}" failed. No retries permitted until 2026-07-30 13:00:41.733845041 +0000 UTC m=+89.565311166 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5c9ec6ef-6498-4094-8613-fb3a59fa4e24-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-cc2dk" (UID: "5c9ec6ef-6498-4094-8613-fb3a59fa4e24") : secret "networking-console-plugin-cert" not found Jul 30 13:00:41.233989 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:41.233917 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cca02c0d-563c-45f0-b51c-4b26093bdf3e-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-kr852\" (UID: \"cca02c0d-563c-45f0-b51c-4b26093bdf3e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-kr852" Jul 30 13:00:41.233989 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:41.233947 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5703055a-5a1f-4546-bb90-1ca9d22e0933-service-ca-bundle\") pod \"router-default-57f58cdc8c-xn7bm\" (UID: \"5703055a-5a1f-4546-bb90-1ca9d22e0933\") " pod="openshift-ingress/router-default-57f58cdc8c-xn7bm" Jul 30 13:00:41.233989 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:41.233978 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l82gd\" (UniqueName: \"kubernetes.io/projected/5703055a-5a1f-4546-bb90-1ca9d22e0933-kube-api-access-l82gd\") pod \"router-default-57f58cdc8c-xn7bm\" (UID: \"5703055a-5a1f-4546-bb90-1ca9d22e0933\") " pod="openshift-ingress/router-default-57f58cdc8c-xn7bm" Jul 30 13:00:41.234093 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:00:41.234041 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 30 13:00:41.234093 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:41.234070 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/5703055a-5a1f-4546-bb90-1ca9d22e0933-default-certificate\") pod \"router-default-57f58cdc8c-xn7bm\" (UID: \"5703055a-5a1f-4546-bb90-1ca9d22e0933\") " pod="openshift-ingress/router-default-57f58cdc8c-xn7bm" Jul 30 13:00:41.234158 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:00:41.234104 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cca02c0d-563c-45f0-b51c-4b26093bdf3e-samples-operator-tls podName:cca02c0d-563c-45f0-b51c-4b26093bdf3e nodeName:}" failed. No retries permitted until 2026-07-30 13:00:41.734085532 +0000 UTC m=+89.565551640 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/cca02c0d-563c-45f0-b51c-4b26093bdf3e-samples-operator-tls") pod "cluster-samples-operator-6748489656-kr852" (UID: "cca02c0d-563c-45f0-b51c-4b26093bdf3e") : secret "samples-operator-tls" not found Jul 30 13:00:41.234158 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:41.234144 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/5703055a-5a1f-4546-bb90-1ca9d22e0933-stats-auth\") pod \"router-default-57f58cdc8c-xn7bm\" (UID: \"5703055a-5a1f-4546-bb90-1ca9d22e0933\") " pod="openshift-ingress/router-default-57f58cdc8c-xn7bm" Jul 30 13:00:41.234377 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:41.234362 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5c9ec6ef-6498-4094-8613-fb3a59fa4e24-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-cc2dk\" (UID: \"5c9ec6ef-6498-4094-8613-fb3a59fa4e24\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-cc2dk" Jul 30 13:00:41.242351 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:41.242332 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pcmr\" (UniqueName: \"kubernetes.io/projected/cca02c0d-563c-45f0-b51c-4b26093bdf3e-kube-api-access-5pcmr\") pod \"cluster-samples-operator-6748489656-kr852\" (UID: \"cca02c0d-563c-45f0-b51c-4b26093bdf3e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-kr852" Jul 30 13:00:41.334689 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:41.334611 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5703055a-5a1f-4546-bb90-1ca9d22e0933-service-ca-bundle\") pod \"router-default-57f58cdc8c-xn7bm\" (UID: \"5703055a-5a1f-4546-bb90-1ca9d22e0933\") " pod="openshift-ingress/router-default-57f58cdc8c-xn7bm" Jul 30 13:00:41.334689 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:41.334649 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l82gd\" (UniqueName: \"kubernetes.io/projected/5703055a-5a1f-4546-bb90-1ca9d22e0933-kube-api-access-l82gd\") pod \"router-default-57f58cdc8c-xn7bm\" (UID: \"5703055a-5a1f-4546-bb90-1ca9d22e0933\") " pod="openshift-ingress/router-default-57f58cdc8c-xn7bm" Jul 30 13:00:41.334923 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:41.334702 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/5703055a-5a1f-4546-bb90-1ca9d22e0933-default-certificate\") pod \"router-default-57f58cdc8c-xn7bm\" (UID: \"5703055a-5a1f-4546-bb90-1ca9d22e0933\") " pod="openshift-ingress/router-default-57f58cdc8c-xn7bm" Jul 30 13:00:41.334923 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:41.334730 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/5703055a-5a1f-4546-bb90-1ca9d22e0933-stats-auth\") pod \"router-default-57f58cdc8c-xn7bm\" (UID: \"5703055a-5a1f-4546-bb90-1ca9d22e0933\") " pod="openshift-ingress/router-default-57f58cdc8c-xn7bm" Jul 30 13:00:41.334923 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:00:41.334806 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5703055a-5a1f-4546-bb90-1ca9d22e0933-service-ca-bundle podName:5703055a-5a1f-4546-bb90-1ca9d22e0933 nodeName:}" failed. No retries permitted until 2026-07-30 13:00:41.834778888 +0000 UTC m=+89.666245014 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5703055a-5a1f-4546-bb90-1ca9d22e0933-service-ca-bundle") pod "router-default-57f58cdc8c-xn7bm" (UID: "5703055a-5a1f-4546-bb90-1ca9d22e0933") : configmap references non-existent config key: service-ca.crt Jul 30 13:00:41.334923 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:41.334830 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5703055a-5a1f-4546-bb90-1ca9d22e0933-metrics-certs\") pod \"router-default-57f58cdc8c-xn7bm\" (UID: \"5703055a-5a1f-4546-bb90-1ca9d22e0933\") " pod="openshift-ingress/router-default-57f58cdc8c-xn7bm" Jul 30 13:00:41.335076 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:00:41.334942 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 30 13:00:41.335076 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:00:41.334994 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5703055a-5a1f-4546-bb90-1ca9d22e0933-metrics-certs podName:5703055a-5a1f-4546-bb90-1ca9d22e0933 nodeName:}" failed. No retries permitted until 2026-07-30 13:00:41.83497901 +0000 UTC m=+89.666445125 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5703055a-5a1f-4546-bb90-1ca9d22e0933-metrics-certs") pod "router-default-57f58cdc8c-xn7bm" (UID: "5703055a-5a1f-4546-bb90-1ca9d22e0933") : secret "router-metrics-certs-default" not found Jul 30 13:00:41.337142 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:41.337123 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/5703055a-5a1f-4546-bb90-1ca9d22e0933-stats-auth\") pod \"router-default-57f58cdc8c-xn7bm\" (UID: \"5703055a-5a1f-4546-bb90-1ca9d22e0933\") " pod="openshift-ingress/router-default-57f58cdc8c-xn7bm" Jul 30 13:00:41.337342 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:41.337310 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/5703055a-5a1f-4546-bb90-1ca9d22e0933-default-certificate\") pod \"router-default-57f58cdc8c-xn7bm\" (UID: \"5703055a-5a1f-4546-bb90-1ca9d22e0933\") " pod="openshift-ingress/router-default-57f58cdc8c-xn7bm" Jul 30 13:00:41.343013 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:41.342994 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l82gd\" (UniqueName: \"kubernetes.io/projected/5703055a-5a1f-4546-bb90-1ca9d22e0933-kube-api-access-l82gd\") pod \"router-default-57f58cdc8c-xn7bm\" (UID: \"5703055a-5a1f-4546-bb90-1ca9d22e0933\") " pod="openshift-ingress/router-default-57f58cdc8c-xn7bm" Jul 30 13:00:41.351221 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:41.351197 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:00:41.411748 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:41.411719 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:00:41.738186 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:41.738149 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5c9ec6ef-6498-4094-8613-fb3a59fa4e24-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-cc2dk\" (UID: \"5c9ec6ef-6498-4094-8613-fb3a59fa4e24\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-cc2dk" Jul 30 13:00:41.738406 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:41.738213 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cca02c0d-563c-45f0-b51c-4b26093bdf3e-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-kr852\" (UID: \"cca02c0d-563c-45f0-b51c-4b26093bdf3e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-kr852" Jul 30 13:00:41.738406 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:00:41.738297 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 30 13:00:41.738406 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:00:41.738318 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 30 13:00:41.738406 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:00:41.738359 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cca02c0d-563c-45f0-b51c-4b26093bdf3e-samples-operator-tls podName:cca02c0d-563c-45f0-b51c-4b26093bdf3e nodeName:}" failed. No retries permitted until 2026-07-30 13:00:42.738345841 +0000 UTC m=+90.569811946 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/cca02c0d-563c-45f0-b51c-4b26093bdf3e-samples-operator-tls") pod "cluster-samples-operator-6748489656-kr852" (UID: "cca02c0d-563c-45f0-b51c-4b26093bdf3e") : secret "samples-operator-tls" not found Jul 30 13:00:41.738406 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:00:41.738372 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c9ec6ef-6498-4094-8613-fb3a59fa4e24-networking-console-plugin-cert podName:5c9ec6ef-6498-4094-8613-fb3a59fa4e24 nodeName:}" failed. No retries permitted until 2026-07-30 13:00:42.738365576 +0000 UTC m=+90.569831678 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5c9ec6ef-6498-4094-8613-fb3a59fa4e24-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-cc2dk" (UID: "5c9ec6ef-6498-4094-8613-fb3a59fa4e24") : secret "networking-console-plugin-cert" not found Jul 30 13:00:41.838910 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:41.838880 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5703055a-5a1f-4546-bb90-1ca9d22e0933-service-ca-bundle\") pod \"router-default-57f58cdc8c-xn7bm\" (UID: \"5703055a-5a1f-4546-bb90-1ca9d22e0933\") " pod="openshift-ingress/router-default-57f58cdc8c-xn7bm" Jul 30 13:00:41.839059 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:41.838986 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5703055a-5a1f-4546-bb90-1ca9d22e0933-metrics-certs\") pod \"router-default-57f58cdc8c-xn7bm\" (UID: \"5703055a-5a1f-4546-bb90-1ca9d22e0933\") " pod="openshift-ingress/router-default-57f58cdc8c-xn7bm" Jul 30 13:00:41.839059 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:00:41.839048 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5703055a-5a1f-4546-bb90-1ca9d22e0933-service-ca-bundle podName:5703055a-5a1f-4546-bb90-1ca9d22e0933 nodeName:}" failed. No retries permitted until 2026-07-30 13:00:42.839028592 +0000 UTC m=+90.670494714 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5703055a-5a1f-4546-bb90-1ca9d22e0933-service-ca-bundle") pod "router-default-57f58cdc8c-xn7bm" (UID: "5703055a-5a1f-4546-bb90-1ca9d22e0933") : configmap references non-existent config key: service-ca.crt Jul 30 13:00:41.839134 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:00:41.839079 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 30 13:00:41.839134 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:00:41.839126 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5703055a-5a1f-4546-bb90-1ca9d22e0933-metrics-certs podName:5703055a-5a1f-4546-bb90-1ca9d22e0933 nodeName:}" failed. No retries permitted until 2026-07-30 13:00:42.839115046 +0000 UTC m=+90.670581166 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5703055a-5a1f-4546-bb90-1ca9d22e0933-metrics-certs") pod "router-default-57f58cdc8c-xn7bm" (UID: "5703055a-5a1f-4546-bb90-1ca9d22e0933") : secret "router-metrics-certs-default" not found Jul 30 13:00:42.745368 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:42.745329 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cca02c0d-563c-45f0-b51c-4b26093bdf3e-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-kr852\" (UID: \"cca02c0d-563c-45f0-b51c-4b26093bdf3e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-kr852" Jul 30 13:00:42.745810 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:42.745468 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5c9ec6ef-6498-4094-8613-fb3a59fa4e24-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-cc2dk\" (UID: \"5c9ec6ef-6498-4094-8613-fb3a59fa4e24\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-cc2dk" Jul 30 13:00:42.745810 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:00:42.745480 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 30 13:00:42.745810 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:00:42.745552 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cca02c0d-563c-45f0-b51c-4b26093bdf3e-samples-operator-tls podName:cca02c0d-563c-45f0-b51c-4b26093bdf3e nodeName:}" failed. No retries permitted until 2026-07-30 13:00:44.745530713 +0000 UTC m=+92.576996840 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/cca02c0d-563c-45f0-b51c-4b26093bdf3e-samples-operator-tls") pod "cluster-samples-operator-6748489656-kr852" (UID: "cca02c0d-563c-45f0-b51c-4b26093bdf3e") : secret "samples-operator-tls" not found Jul 30 13:00:42.745810 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:00:42.745574 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 30 13:00:42.745810 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:00:42.745647 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c9ec6ef-6498-4094-8613-fb3a59fa4e24-networking-console-plugin-cert podName:5c9ec6ef-6498-4094-8613-fb3a59fa4e24 nodeName:}" failed. No retries permitted until 2026-07-30 13:00:44.745627711 +0000 UTC m=+92.577093815 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5c9ec6ef-6498-4094-8613-fb3a59fa4e24-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-cc2dk" (UID: "5c9ec6ef-6498-4094-8613-fb3a59fa4e24") : secret "networking-console-plugin-cert" not found Jul 30 13:00:42.846592 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:42.846543 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5703055a-5a1f-4546-bb90-1ca9d22e0933-metrics-certs\") pod \"router-default-57f58cdc8c-xn7bm\" (UID: \"5703055a-5a1f-4546-bb90-1ca9d22e0933\") " pod="openshift-ingress/router-default-57f58cdc8c-xn7bm" Jul 30 13:00:42.846728 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:42.846613 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5703055a-5a1f-4546-bb90-1ca9d22e0933-service-ca-bundle\") pod \"router-default-57f58cdc8c-xn7bm\" (UID: \"5703055a-5a1f-4546-bb90-1ca9d22e0933\") " pod="openshift-ingress/router-default-57f58cdc8c-xn7bm" Jul 30 13:00:42.846728 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:00:42.846698 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 30 13:00:42.846820 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:00:42.846736 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5703055a-5a1f-4546-bb90-1ca9d22e0933-service-ca-bundle podName:5703055a-5a1f-4546-bb90-1ca9d22e0933 nodeName:}" failed. No retries permitted until 2026-07-30 13:00:44.846723376 +0000 UTC m=+92.678189479 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5703055a-5a1f-4546-bb90-1ca9d22e0933-service-ca-bundle") pod "router-default-57f58cdc8c-xn7bm" (UID: "5703055a-5a1f-4546-bb90-1ca9d22e0933") : configmap references non-existent config key: service-ca.crt Jul 30 13:00:42.846820 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:00:42.846750 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5703055a-5a1f-4546-bb90-1ca9d22e0933-metrics-certs podName:5703055a-5a1f-4546-bb90-1ca9d22e0933 nodeName:}" failed. No retries permitted until 2026-07-30 13:00:44.846744475 +0000 UTC m=+92.678210578 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5703055a-5a1f-4546-bb90-1ca9d22e0933-metrics-certs") pod "router-default-57f58cdc8c-xn7bm" (UID: "5703055a-5a1f-4546-bb90-1ca9d22e0933") : secret "router-metrics-certs-default" not found Jul 30 13:00:43.632015 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:43.631984 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:00:44.759314 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:44.759259 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cca02c0d-563c-45f0-b51c-4b26093bdf3e-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-kr852\" (UID: \"cca02c0d-563c-45f0-b51c-4b26093bdf3e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-kr852" Jul 30 13:00:44.759757 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:44.759361 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5c9ec6ef-6498-4094-8613-fb3a59fa4e24-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-cc2dk\" (UID: \"5c9ec6ef-6498-4094-8613-fb3a59fa4e24\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-cc2dk" Jul 30 13:00:44.759757 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:00:44.759456 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 30 13:00:44.759757 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:00:44.759477 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 30 13:00:44.759757 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:00:44.759528 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cca02c0d-563c-45f0-b51c-4b26093bdf3e-samples-operator-tls podName:cca02c0d-563c-45f0-b51c-4b26093bdf3e nodeName:}" failed. No retries permitted until 2026-07-30 13:00:48.759511162 +0000 UTC m=+96.590977295 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/cca02c0d-563c-45f0-b51c-4b26093bdf3e-samples-operator-tls") pod "cluster-samples-operator-6748489656-kr852" (UID: "cca02c0d-563c-45f0-b51c-4b26093bdf3e") : secret "samples-operator-tls" not found Jul 30 13:00:44.759757 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:00:44.759542 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c9ec6ef-6498-4094-8613-fb3a59fa4e24-networking-console-plugin-cert podName:5c9ec6ef-6498-4094-8613-fb3a59fa4e24 nodeName:}" failed. No retries permitted until 2026-07-30 13:00:48.75953655 +0000 UTC m=+96.591002653 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5c9ec6ef-6498-4094-8613-fb3a59fa4e24-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-cc2dk" (UID: "5c9ec6ef-6498-4094-8613-fb3a59fa4e24") : secret "networking-console-plugin-cert" not found Jul 30 13:00:44.860279 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:44.860244 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5703055a-5a1f-4546-bb90-1ca9d22e0933-service-ca-bundle\") pod \"router-default-57f58cdc8c-xn7bm\" (UID: \"5703055a-5a1f-4546-bb90-1ca9d22e0933\") " pod="openshift-ingress/router-default-57f58cdc8c-xn7bm" Jul 30 13:00:44.860461 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:00:44.860410 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5703055a-5a1f-4546-bb90-1ca9d22e0933-service-ca-bundle podName:5703055a-5a1f-4546-bb90-1ca9d22e0933 nodeName:}" failed. No retries permitted until 2026-07-30 13:00:48.860390063 +0000 UTC m=+96.691856181 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5703055a-5a1f-4546-bb90-1ca9d22e0933-service-ca-bundle") pod "router-default-57f58cdc8c-xn7bm" (UID: "5703055a-5a1f-4546-bb90-1ca9d22e0933") : configmap references non-existent config key: service-ca.crt Jul 30 13:00:44.860513 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:44.860490 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5703055a-5a1f-4546-bb90-1ca9d22e0933-metrics-certs\") pod \"router-default-57f58cdc8c-xn7bm\" (UID: \"5703055a-5a1f-4546-bb90-1ca9d22e0933\") " pod="openshift-ingress/router-default-57f58cdc8c-xn7bm" Jul 30 13:00:44.860618 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:00:44.860605 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 30 13:00:44.860663 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:00:44.860654 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5703055a-5a1f-4546-bb90-1ca9d22e0933-metrics-certs podName:5703055a-5a1f-4546-bb90-1ca9d22e0933 nodeName:}" failed. No retries permitted until 2026-07-30 13:00:48.860640676 +0000 UTC m=+96.692106793 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5703055a-5a1f-4546-bb90-1ca9d22e0933-metrics-certs") pod "router-default-57f58cdc8c-xn7bm" (UID: "5703055a-5a1f-4546-bb90-1ca9d22e0933") : secret "router-metrics-certs-default" not found Jul 30 13:00:45.391846 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:45.391812 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-bq2t2"] Jul 30 13:00:45.396063 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:45.396044 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bq2t2" Jul 30 13:00:45.399212 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:45.399192 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 30 13:00:45.399409 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:45.399215 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 30 13:00:45.399499 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:45.399442 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 30 13:00:45.400572 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:45.400557 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 30 13:00:45.401962 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:45.401940 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-nzhhh\"" Jul 30 13:00:45.417799 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:45.417774 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bq2t2"] Jul 30 13:00:45.436994 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:45.436966 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:00:45.464377 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:45.464350 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7239b730-25c6-4df2-9c23-fb9ae5536bca-data-volume\") pod \"insights-runtime-extractor-bq2t2\" (UID: \"7239b730-25c6-4df2-9c23-fb9ae5536bca\") " pod="openshift-insights/insights-runtime-extractor-bq2t2" Jul 30 13:00:45.464493 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:45.464397 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqjpz\" (UniqueName: \"kubernetes.io/projected/7239b730-25c6-4df2-9c23-fb9ae5536bca-kube-api-access-bqjpz\") pod \"insights-runtime-extractor-bq2t2\" (UID: \"7239b730-25c6-4df2-9c23-fb9ae5536bca\") " pod="openshift-insights/insights-runtime-extractor-bq2t2" Jul 30 13:00:45.464493 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:45.464432 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7239b730-25c6-4df2-9c23-fb9ae5536bca-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bq2t2\" (UID: \"7239b730-25c6-4df2-9c23-fb9ae5536bca\") " pod="openshift-insights/insights-runtime-extractor-bq2t2" Jul 30 13:00:45.464493 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:45.464475 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7239b730-25c6-4df2-9c23-fb9ae5536bca-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bq2t2\" (UID: \"7239b730-25c6-4df2-9c23-fb9ae5536bca\") " pod="openshift-insights/insights-runtime-extractor-bq2t2" Jul 30 13:00:45.464612 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:45.464509 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7239b730-25c6-4df2-9c23-fb9ae5536bca-crio-socket\") pod \"insights-runtime-extractor-bq2t2\" (UID: \"7239b730-25c6-4df2-9c23-fb9ae5536bca\") " pod="openshift-insights/insights-runtime-extractor-bq2t2" Jul 30 13:00:45.561747 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:45.561685 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:00:45.565677 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:45.565652 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqjpz\" (UniqueName: \"kubernetes.io/projected/7239b730-25c6-4df2-9c23-fb9ae5536bca-kube-api-access-bqjpz\") pod \"insights-runtime-extractor-bq2t2\" (UID: \"7239b730-25c6-4df2-9c23-fb9ae5536bca\") " pod="openshift-insights/insights-runtime-extractor-bq2t2" Jul 30 13:00:45.565759 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:45.565689 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7239b730-25c6-4df2-9c23-fb9ae5536bca-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bq2t2\" (UID: \"7239b730-25c6-4df2-9c23-fb9ae5536bca\") " pod="openshift-insights/insights-runtime-extractor-bq2t2" Jul 30 13:00:45.565759 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:45.565718 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7239b730-25c6-4df2-9c23-fb9ae5536bca-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bq2t2\" (UID: \"7239b730-25c6-4df2-9c23-fb9ae5536bca\") " pod="openshift-insights/insights-runtime-extractor-bq2t2" Jul 30 13:00:45.565759 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:45.565747 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7239b730-25c6-4df2-9c23-fb9ae5536bca-crio-socket\") pod \"insights-runtime-extractor-bq2t2\" (UID: \"7239b730-25c6-4df2-9c23-fb9ae5536bca\") " pod="openshift-insights/insights-runtime-extractor-bq2t2" Jul 30 13:00:45.565869 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:00:45.565807 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 30 13:00:45.565869 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:00:45.565833 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 30 13:00:45.565869 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:45.565860 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7239b730-25c6-4df2-9c23-fb9ae5536bca-data-volume\") pod \"insights-runtime-extractor-bq2t2\" (UID: \"7239b730-25c6-4df2-9c23-fb9ae5536bca\") " pod="openshift-insights/insights-runtime-extractor-bq2t2" Jul 30 13:00:45.565968 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:00:45.565875 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7239b730-25c6-4df2-9c23-fb9ae5536bca-kube-rbac-proxy-cm podName:7239b730-25c6-4df2-9c23-fb9ae5536bca nodeName:}" failed. No retries permitted until 2026-07-30 13:00:46.065854823 +0000 UTC m=+93.897320955 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7239b730-25c6-4df2-9c23-fb9ae5536bca-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bq2t2" (UID: "7239b730-25c6-4df2-9c23-fb9ae5536bca") : configmap "kube-rbac-proxy" not found Jul 30 13:00:45.565968 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:45.565876 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7239b730-25c6-4df2-9c23-fb9ae5536bca-crio-socket\") pod \"insights-runtime-extractor-bq2t2\" (UID: \"7239b730-25c6-4df2-9c23-fb9ae5536bca\") " pod="openshift-insights/insights-runtime-extractor-bq2t2" Jul 30 13:00:45.565968 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:00:45.565898 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7239b730-25c6-4df2-9c23-fb9ae5536bca-insights-runtime-extractor-tls podName:7239b730-25c6-4df2-9c23-fb9ae5536bca nodeName:}" failed. No retries permitted until 2026-07-30 13:00:46.065889294 +0000 UTC m=+93.897355426 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7239b730-25c6-4df2-9c23-fb9ae5536bca-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bq2t2" (UID: "7239b730-25c6-4df2-9c23-fb9ae5536bca") : secret "insights-runtime-extractor-tls" not found Jul 30 13:00:45.566157 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:45.566142 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7239b730-25c6-4df2-9c23-fb9ae5536bca-data-volume\") pod \"insights-runtime-extractor-bq2t2\" (UID: \"7239b730-25c6-4df2-9c23-fb9ae5536bca\") " pod="openshift-insights/insights-runtime-extractor-bq2t2" Jul 30 13:00:45.574668 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:45.574634 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqjpz\" (UniqueName: \"kubernetes.io/projected/7239b730-25c6-4df2-9c23-fb9ae5536bca-kube-api-access-bqjpz\") pod \"insights-runtime-extractor-bq2t2\" (UID: \"7239b730-25c6-4df2-9c23-fb9ae5536bca\") " pod="openshift-insights/insights-runtime-extractor-bq2t2" Jul 30 13:00:46.070907 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:46.070861 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7239b730-25c6-4df2-9c23-fb9ae5536bca-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bq2t2\" (UID: \"7239b730-25c6-4df2-9c23-fb9ae5536bca\") " pod="openshift-insights/insights-runtime-extractor-bq2t2" Jul 30 13:00:46.071339 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:46.070920 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7239b730-25c6-4df2-9c23-fb9ae5536bca-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bq2t2\" (UID: \"7239b730-25c6-4df2-9c23-fb9ae5536bca\") " pod="openshift-insights/insights-runtime-extractor-bq2t2" Jul 30 13:00:46.071339 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:00:46.071016 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 30 13:00:46.071339 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:00:46.071051 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 30 13:00:46.071339 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:00:46.071081 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7239b730-25c6-4df2-9c23-fb9ae5536bca-insights-runtime-extractor-tls podName:7239b730-25c6-4df2-9c23-fb9ae5536bca nodeName:}" failed. No retries permitted until 2026-07-30 13:00:47.071066886 +0000 UTC m=+94.902532989 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7239b730-25c6-4df2-9c23-fb9ae5536bca-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bq2t2" (UID: "7239b730-25c6-4df2-9c23-fb9ae5536bca") : secret "insights-runtime-extractor-tls" not found Jul 30 13:00:46.071339 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:00:46.071099 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7239b730-25c6-4df2-9c23-fb9ae5536bca-kube-rbac-proxy-cm podName:7239b730-25c6-4df2-9c23-fb9ae5536bca nodeName:}" failed. No retries permitted until 2026-07-30 13:00:47.071086867 +0000 UTC m=+94.902552970 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7239b730-25c6-4df2-9c23-fb9ae5536bca-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bq2t2" (UID: "7239b730-25c6-4df2-9c23-fb9ae5536bca") : configmap "kube-rbac-proxy" not found Jul 30 13:00:46.110691 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:46.110662 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:00:46.206737 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:46.206699 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:00:47.080458 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:47.080392 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7239b730-25c6-4df2-9c23-fb9ae5536bca-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bq2t2\" (UID: \"7239b730-25c6-4df2-9c23-fb9ae5536bca\") " pod="openshift-insights/insights-runtime-extractor-bq2t2" Jul 30 13:00:47.080458 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:47.080465 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7239b730-25c6-4df2-9c23-fb9ae5536bca-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bq2t2\" (UID: \"7239b730-25c6-4df2-9c23-fb9ae5536bca\") " pod="openshift-insights/insights-runtime-extractor-bq2t2" Jul 30 13:00:47.080885 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:00:47.080547 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 30 13:00:47.080885 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:00:47.080581 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 30 13:00:47.080885 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:00:47.080632 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7239b730-25c6-4df2-9c23-fb9ae5536bca-kube-rbac-proxy-cm podName:7239b730-25c6-4df2-9c23-fb9ae5536bca nodeName:}" failed. No retries permitted until 2026-07-30 13:00:49.080612989 +0000 UTC m=+96.912079108 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7239b730-25c6-4df2-9c23-fb9ae5536bca-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bq2t2" (UID: "7239b730-25c6-4df2-9c23-fb9ae5536bca") : configmap "kube-rbac-proxy" not found Jul 30 13:00:47.080885 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:00:47.080648 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7239b730-25c6-4df2-9c23-fb9ae5536bca-insights-runtime-extractor-tls podName:7239b730-25c6-4df2-9c23-fb9ae5536bca nodeName:}" failed. No retries permitted until 2026-07-30 13:00:49.080640297 +0000 UTC m=+96.912106401 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7239b730-25c6-4df2-9c23-fb9ae5536bca-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bq2t2" (UID: "7239b730-25c6-4df2-9c23-fb9ae5536bca") : secret "insights-runtime-extractor-tls" not found Jul 30 13:00:47.578678 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:47.578650 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-x7bbz_a4d9b0b7-6474-457f-b742-05d47589d56f/dns-node-resolver/0.log" Jul 30 13:00:47.866340 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:47.866246 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:00:48.378230 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:48.378207 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9cpnl_8eca3445-f081-4f35-aa2c-603a2b80d815/node-ca/0.log" Jul 30 13:00:48.794953 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:48.794921 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cca02c0d-563c-45f0-b51c-4b26093bdf3e-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-kr852\" (UID: \"cca02c0d-563c-45f0-b51c-4b26093bdf3e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-kr852" Jul 30 13:00:48.795146 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:48.794973 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5c9ec6ef-6498-4094-8613-fb3a59fa4e24-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-cc2dk\" (UID: \"5c9ec6ef-6498-4094-8613-fb3a59fa4e24\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-cc2dk" Jul 30 13:00:48.795146 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:00:48.795079 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 30 13:00:48.795146 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:00:48.795128 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c9ec6ef-6498-4094-8613-fb3a59fa4e24-networking-console-plugin-cert podName:5c9ec6ef-6498-4094-8613-fb3a59fa4e24 nodeName:}" failed. No retries permitted until 2026-07-30 13:00:56.795115204 +0000 UTC m=+104.626581307 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5c9ec6ef-6498-4094-8613-fb3a59fa4e24-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-cc2dk" (UID: "5c9ec6ef-6498-4094-8613-fb3a59fa4e24") : secret "networking-console-plugin-cert" not found Jul 30 13:00:48.795146 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:00:48.795082 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 30 13:00:48.795362 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:00:48.795158 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cca02c0d-563c-45f0-b51c-4b26093bdf3e-samples-operator-tls podName:cca02c0d-563c-45f0-b51c-4b26093bdf3e nodeName:}" failed. No retries permitted until 2026-07-30 13:00:56.795152865 +0000 UTC m=+104.626618968 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/cca02c0d-563c-45f0-b51c-4b26093bdf3e-samples-operator-tls") pod "cluster-samples-operator-6748489656-kr852" (UID: "cca02c0d-563c-45f0-b51c-4b26093bdf3e") : secret "samples-operator-tls" not found Jul 30 13:00:48.895654 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:48.895619 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5703055a-5a1f-4546-bb90-1ca9d22e0933-metrics-certs\") pod \"router-default-57f58cdc8c-xn7bm\" (UID: \"5703055a-5a1f-4546-bb90-1ca9d22e0933\") " pod="openshift-ingress/router-default-57f58cdc8c-xn7bm" Jul 30 13:00:48.895856 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:48.895726 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5703055a-5a1f-4546-bb90-1ca9d22e0933-service-ca-bundle\") pod \"router-default-57f58cdc8c-xn7bm\" (UID: \"5703055a-5a1f-4546-bb90-1ca9d22e0933\") " pod="openshift-ingress/router-default-57f58cdc8c-xn7bm" Jul 30 13:00:48.895856 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:00:48.895783 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 30 13:00:48.895856 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:00:48.895830 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5703055a-5a1f-4546-bb90-1ca9d22e0933-service-ca-bundle podName:5703055a-5a1f-4546-bb90-1ca9d22e0933 nodeName:}" failed. No retries permitted until 2026-07-30 13:00:56.895816143 +0000 UTC m=+104.727282248 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5703055a-5a1f-4546-bb90-1ca9d22e0933-service-ca-bundle") pod "router-default-57f58cdc8c-xn7bm" (UID: "5703055a-5a1f-4546-bb90-1ca9d22e0933") : configmap references non-existent config key: service-ca.crt Jul 30 13:00:48.895856 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:00:48.895846 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5703055a-5a1f-4546-bb90-1ca9d22e0933-metrics-certs podName:5703055a-5a1f-4546-bb90-1ca9d22e0933 nodeName:}" failed. No retries permitted until 2026-07-30 13:00:56.895839105 +0000 UTC m=+104.727305208 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5703055a-5a1f-4546-bb90-1ca9d22e0933-metrics-certs") pod "router-default-57f58cdc8c-xn7bm" (UID: "5703055a-5a1f-4546-bb90-1ca9d22e0933") : secret "router-metrics-certs-default" not found Jul 30 13:00:49.097360 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:49.097261 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7239b730-25c6-4df2-9c23-fb9ae5536bca-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bq2t2\" (UID: \"7239b730-25c6-4df2-9c23-fb9ae5536bca\") " pod="openshift-insights/insights-runtime-extractor-bq2t2" Jul 30 13:00:49.097360 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:49.097320 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7239b730-25c6-4df2-9c23-fb9ae5536bca-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bq2t2\" (UID: \"7239b730-25c6-4df2-9c23-fb9ae5536bca\") " pod="openshift-insights/insights-runtime-extractor-bq2t2" Jul 30 13:00:49.097567 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:00:49.097435 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 30 13:00:49.097567 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:00:49.097460 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 30 13:00:49.097567 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:00:49.097493 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7239b730-25c6-4df2-9c23-fb9ae5536bca-kube-rbac-proxy-cm podName:7239b730-25c6-4df2-9c23-fb9ae5536bca nodeName:}" failed. No retries permitted until 2026-07-30 13:00:53.09748058 +0000 UTC m=+100.928946684 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7239b730-25c6-4df2-9c23-fb9ae5536bca-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bq2t2" (UID: "7239b730-25c6-4df2-9c23-fb9ae5536bca") : configmap "kube-rbac-proxy" not found Jul 30 13:00:49.097567 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:00:49.097521 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7239b730-25c6-4df2-9c23-fb9ae5536bca-insights-runtime-extractor-tls podName:7239b730-25c6-4df2-9c23-fb9ae5536bca nodeName:}" failed. No retries permitted until 2026-07-30 13:00:53.097506535 +0000 UTC m=+100.928972642 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7239b730-25c6-4df2-9c23-fb9ae5536bca-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bq2t2" (UID: "7239b730-25c6-4df2-9c23-fb9ae5536bca") : secret "insights-runtime-extractor-tls" not found Jul 30 13:00:49.332138 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:49.332087 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:00:49.378123 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:49.378061 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xzr5s_4c0375ad-3873-408c-95c6-4c826bb4629a/serve-healthcheck-canary/0.log" Jul 30 13:00:49.392035 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:49.392005 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:00:49.657926 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:49.657842 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:00:49.904804 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:49.904768 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:00:50.207041 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:50.207007 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:00:50.311385 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:50.311352 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:00:50.497042 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:50.496956 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:00:51.010711 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:51.010681 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/16c04b61-06b6-45f8-a4c6-cb1e1652aa0c-registry-tls\") pod \"image-registry-7b957f76f4-w85x4\" (UID: \"16c04b61-06b6-45f8-a4c6-cb1e1652aa0c\") " pod="openshift-image-registry/image-registry-7b957f76f4-w85x4" Jul 30 13:00:51.010874 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:51.010762 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a34ce5ce-94cf-4ab0-923d-c12612130e0a-metrics-tls\") pod \"dns-default-598js\" (UID: \"a34ce5ce-94cf-4ab0-923d-c12612130e0a\") " pod="openshift-dns/dns-default-598js" Jul 30 13:00:51.010874 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:00:51.010842 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 30 13:00:51.010874 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:00:51.010858 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 30 13:00:51.010874 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:00:51.010859 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b957f76f4-w85x4: secret "image-registry-tls" not found Jul 30 13:00:51.011003 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:00:51.010918 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/16c04b61-06b6-45f8-a4c6-cb1e1652aa0c-registry-tls podName:16c04b61-06b6-45f8-a4c6-cb1e1652aa0c nodeName:}" failed. No retries permitted until 2026-07-30 13:01:55.01090213 +0000 UTC m=+162.842368240 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/16c04b61-06b6-45f8-a4c6-cb1e1652aa0c-registry-tls") pod "image-registry-7b957f76f4-w85x4" (UID: "16c04b61-06b6-45f8-a4c6-cb1e1652aa0c") : secret "image-registry-tls" not found Jul 30 13:00:51.011003 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:00:51.010932 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a34ce5ce-94cf-4ab0-923d-c12612130e0a-metrics-tls podName:a34ce5ce-94cf-4ab0-923d-c12612130e0a nodeName:}" failed. No retries permitted until 2026-07-30 13:01:55.010926903 +0000 UTC m=+162.842393005 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a34ce5ce-94cf-4ab0-923d-c12612130e0a-metrics-tls") pod "dns-default-598js" (UID: "a34ce5ce-94cf-4ab0-923d-c12612130e0a") : secret "dns-default-metrics-tls" not found Jul 30 13:00:51.917830 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:51.917796 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:00:51.980707 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:51.980676 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:00:53.127792 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:53.127756 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7239b730-25c6-4df2-9c23-fb9ae5536bca-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bq2t2\" (UID: \"7239b730-25c6-4df2-9c23-fb9ae5536bca\") " pod="openshift-insights/insights-runtime-extractor-bq2t2" Jul 30 13:00:53.128260 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:53.127803 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7239b730-25c6-4df2-9c23-fb9ae5536bca-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bq2t2\" (UID: \"7239b730-25c6-4df2-9c23-fb9ae5536bca\") " pod="openshift-insights/insights-runtime-extractor-bq2t2" Jul 30 13:00:53.128260 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:00:53.127965 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 30 13:00:53.128260 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:00:53.127981 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 30 13:00:53.128260 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:00:53.128047 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7239b730-25c6-4df2-9c23-fb9ae5536bca-insights-runtime-extractor-tls podName:7239b730-25c6-4df2-9c23-fb9ae5536bca nodeName:}" failed. No retries permitted until 2026-07-30 13:01:01.1280234 +0000 UTC m=+108.959489521 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7239b730-25c6-4df2-9c23-fb9ae5536bca-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bq2t2" (UID: "7239b730-25c6-4df2-9c23-fb9ae5536bca") : secret "insights-runtime-extractor-tls" not found Jul 30 13:00:53.128260 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:00:53.128093 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7239b730-25c6-4df2-9c23-fb9ae5536bca-kube-rbac-proxy-cm podName:7239b730-25c6-4df2-9c23-fb9ae5536bca nodeName:}" failed. No retries permitted until 2026-07-30 13:01:01.128080302 +0000 UTC m=+108.959546405 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7239b730-25c6-4df2-9c23-fb9ae5536bca-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bq2t2" (UID: "7239b730-25c6-4df2-9c23-fb9ae5536bca") : configmap "kube-rbac-proxy" not found Jul 30 13:00:53.426783 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:53.426688 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:00:53.526389 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:53.526356 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:00:53.651173 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:53.651137 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:00:53.864771 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:53.864740 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:00:54.045375 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:54.045340 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:00:54.110503 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:54.110475 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-8vppx" Jul 30 13:00:54.451431 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:54.451378 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:00:54.641404 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:54.641368 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:00:55.188428 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:55.188353 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:00:55.477297 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:55.477263 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:00:55.639380 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:55.639341 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:00:55.705607 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:55.705581 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:00:56.237825 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:56.237781 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:00:56.436476 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:56.436426 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:00:56.637786 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:56.637698 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:00:56.839134 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:56.839104 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:00:56.858576 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:56.858546 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cca02c0d-563c-45f0-b51c-4b26093bdf3e-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-kr852\" (UID: \"cca02c0d-563c-45f0-b51c-4b26093bdf3e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-kr852" Jul 30 13:00:56.858739 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:56.858609 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5c9ec6ef-6498-4094-8613-fb3a59fa4e24-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-cc2dk\" (UID: \"5c9ec6ef-6498-4094-8613-fb3a59fa4e24\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-cc2dk" Jul 30 13:00:56.858739 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:00:56.858725 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 30 13:00:56.858849 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:00:56.858814 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c9ec6ef-6498-4094-8613-fb3a59fa4e24-networking-console-plugin-cert podName:5c9ec6ef-6498-4094-8613-fb3a59fa4e24 nodeName:}" failed. No retries permitted until 2026-07-30 13:01:12.858786076 +0000 UTC m=+120.690252196 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5c9ec6ef-6498-4094-8613-fb3a59fa4e24-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-cc2dk" (UID: "5c9ec6ef-6498-4094-8613-fb3a59fa4e24") : secret "networking-console-plugin-cert" not found Jul 30 13:00:56.860892 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:56.860871 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cca02c0d-563c-45f0-b51c-4b26093bdf3e-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-kr852\" (UID: \"cca02c0d-563c-45f0-b51c-4b26093bdf3e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-kr852" Jul 30 13:00:56.938444 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:56.938352 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:00:56.959359 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:56.959332 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5703055a-5a1f-4546-bb90-1ca9d22e0933-metrics-certs\") pod \"router-default-57f58cdc8c-xn7bm\" (UID: \"5703055a-5a1f-4546-bb90-1ca9d22e0933\") " pod="openshift-ingress/router-default-57f58cdc8c-xn7bm" Jul 30 13:00:56.959518 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:56.959503 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5703055a-5a1f-4546-bb90-1ca9d22e0933-service-ca-bundle\") pod \"router-default-57f58cdc8c-xn7bm\" (UID: \"5703055a-5a1f-4546-bb90-1ca9d22e0933\") " pod="openshift-ingress/router-default-57f58cdc8c-xn7bm" Jul 30 13:00:56.959632 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:00:56.959621 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5703055a-5a1f-4546-bb90-1ca9d22e0933-service-ca-bundle podName:5703055a-5a1f-4546-bb90-1ca9d22e0933 nodeName:}" failed. No retries permitted until 2026-07-30 13:01:12.959608134 +0000 UTC m=+120.791074241 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5703055a-5a1f-4546-bb90-1ca9d22e0933-service-ca-bundle") pod "router-default-57f58cdc8c-xn7bm" (UID: "5703055a-5a1f-4546-bb90-1ca9d22e0933") : configmap references non-existent config key: service-ca.crt Jul 30 13:00:56.961651 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:56.961625 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5703055a-5a1f-4546-bb90-1ca9d22e0933-metrics-certs\") pod \"router-default-57f58cdc8c-xn7bm\" (UID: \"5703055a-5a1f-4546-bb90-1ca9d22e0933\") " pod="openshift-ingress/router-default-57f58cdc8c-xn7bm" Jul 30 13:00:56.986893 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:56.986866 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-kr852" Jul 30 13:00:57.132171 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:57.132137 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-kr852"] Jul 30 13:00:57.835526 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:57.835489 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:00:58.037564 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:58.037509 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:00:58.193890 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:58.193801 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-kr852" event={"ID":"cca02c0d-563c-45f0-b51c-4b26093bdf3e","Type":"ContainerStarted","Data":"4d00bf5d292303e724f837417e577c653ec11623f328db27fe5d24a0ce35a8fb"} Jul 30 13:00:58.433928 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:58.433897 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:00:58.593299 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:58.593265 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:00:58.694434 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:58.694383 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:00:59.035463 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:59.035433 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:00:59.197917 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:59.197881 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-kr852" event={"ID":"cca02c0d-563c-45f0-b51c-4b26093bdf3e","Type":"ContainerStarted","Data":"ff28f9382e9c06b8650559e7f12dc48cc7bd8bc91fc79ee28ea8b932e2d20e99"} Jul 30 13:00:59.198086 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:59.197937 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-kr852" event={"ID":"cca02c0d-563c-45f0-b51c-4b26093bdf3e","Type":"ContainerStarted","Data":"18f9146e7b0b0376e7a250eb6cbcc393f7431ac7869d1816db4485565caaa901"} Jul 30 13:00:59.215750 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:59.215695 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-kr852" podStartSLOduration=16.42017015 podStartE2EDuration="18.215675499s" totalImagesPullingTime="1.795505349s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:00:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:00:59.214383365 +0000 UTC m=+107.045849491" watchObservedRunningTime="2026-07-30 13:00:59.215675499 +0000 UTC m=+107.047141626" Jul 30 13:00:59.438151 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:59.438060 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:00:59.838405 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:00:59.838361 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:01:00.433330 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:00.433298 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:01:01.035882 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:01.035843 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:01:01.191214 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:01.191180 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7239b730-25c6-4df2-9c23-fb9ae5536bca-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bq2t2\" (UID: \"7239b730-25c6-4df2-9c23-fb9ae5536bca\") " pod="openshift-insights/insights-runtime-extractor-bq2t2" Jul 30 13:01:01.191214 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:01.191217 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7239b730-25c6-4df2-9c23-fb9ae5536bca-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bq2t2\" (UID: \"7239b730-25c6-4df2-9c23-fb9ae5536bca\") " pod="openshift-insights/insights-runtime-extractor-bq2t2" Jul 30 13:01:01.191871 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:01.191851 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7239b730-25c6-4df2-9c23-fb9ae5536bca-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bq2t2\" (UID: \"7239b730-25c6-4df2-9c23-fb9ae5536bca\") " pod="openshift-insights/insights-runtime-extractor-bq2t2" Jul 30 13:01:01.193472 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:01.193455 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7239b730-25c6-4df2-9c23-fb9ae5536bca-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bq2t2\" (UID: \"7239b730-25c6-4df2-9c23-fb9ae5536bca\") " pod="openshift-insights/insights-runtime-extractor-bq2t2" Jul 30 13:01:01.239224 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:01.239193 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:01:01.305263 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:01.305194 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bq2t2" Jul 30 13:01:01.436180 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:01.436149 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bq2t2"] Jul 30 13:01:01.439165 ip-10-0-133-230 kubenswrapper[2579]: W0730 13:01:01.439141 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7239b730_25c6_4df2_9c23_fb9ae5536bca.slice/crio-e2a23e93b70e84475c8bd048388164f93dc43ff3ebd70bfb30a4be3a56564688 WatchSource:0}: Error finding container e2a23e93b70e84475c8bd048388164f93dc43ff3ebd70bfb30a4be3a56564688: Status 404 returned error can't find the container with id e2a23e93b70e84475c8bd048388164f93dc43ff3ebd70bfb30a4be3a56564688 Jul 30 13:01:01.464078 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:01.464032 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:01:01.640832 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:01.640746 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:01:02.201574 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:02.201539 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:01:02.206982 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:02.206959 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bq2t2" event={"ID":"7239b730-25c6-4df2-9c23-fb9ae5536bca","Type":"ContainerStarted","Data":"e2a23e93b70e84475c8bd048388164f93dc43ff3ebd70bfb30a4be3a56564688"} Jul 30 13:01:07.182853 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:07.182802 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:01:07.280462 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:07.280386 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:01:07.493261 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:07.493220 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:01:07.554207 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:07.554164 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:01:07.644905 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:07.644867 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:01:08.225780 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:08.225739 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bq2t2" event={"ID":"7239b730-25c6-4df2-9c23-fb9ae5536bca","Type":"ContainerStarted","Data":"5c3c37a2a8d210812655b47b33fb8597ec94ed7896b41a057522baa2f8ef32db"} Jul 30 13:01:08.434764 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:08.434661 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:01:08.494673 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:08.494502 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:01:09.657337 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:09.657297 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:01:09.723764 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:09.723710 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:01:11.056538 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:11.055810 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-cj5lq"] Jul 30 13:01:11.070165 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:11.070116 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-cj5lq" Jul 30 13:01:11.071454 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:11.071371 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-cj5lq"] Jul 30 13:01:11.072884 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:11.072859 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 30 13:01:11.073057 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:11.072996 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 30 13:01:11.073253 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:11.073234 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-s5t27\"" Jul 30 13:01:11.177603 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:11.177561 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f62md\" (UniqueName: \"kubernetes.io/projected/30407988-1b56-4ecd-9756-1f503336e72f-kube-api-access-f62md\") pod \"downloads-7c97dc4555-cj5lq\" (UID: \"30407988-1b56-4ecd-9756-1f503336e72f\") " pod="openshift-console/downloads-7c97dc4555-cj5lq" Jul 30 13:01:11.278554 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:11.278521 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f62md\" (UniqueName: \"kubernetes.io/projected/30407988-1b56-4ecd-9756-1f503336e72f-kube-api-access-f62md\") pod \"downloads-7c97dc4555-cj5lq\" (UID: \"30407988-1b56-4ecd-9756-1f503336e72f\") " pod="openshift-console/downloads-7c97dc4555-cj5lq" Jul 30 13:01:11.288472 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:11.288445 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f62md\" (UniqueName: \"kubernetes.io/projected/30407988-1b56-4ecd-9756-1f503336e72f-kube-api-access-f62md\") pod \"downloads-7c97dc4555-cj5lq\" (UID: \"30407988-1b56-4ecd-9756-1f503336e72f\") " pod="openshift-console/downloads-7c97dc4555-cj5lq" Jul 30 13:01:11.380836 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:11.380757 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-cj5lq" Jul 30 13:01:11.513673 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:11.513637 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-cj5lq"] Jul 30 13:01:11.517806 ip-10-0-133-230 kubenswrapper[2579]: W0730 13:01:11.517772 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30407988_1b56_4ecd_9756_1f503336e72f.slice/crio-2acf029e3b66b2917aec30a006dbc75ddff7635f945718ede20781b2bc93669b WatchSource:0}: Error finding container 2acf029e3b66b2917aec30a006dbc75ddff7635f945718ede20781b2bc93669b: Status 404 returned error can't find the container with id 2acf029e3b66b2917aec30a006dbc75ddff7635f945718ede20781b2bc93669b Jul 30 13:01:12.242213 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:12.242173 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bq2t2" event={"ID":"7239b730-25c6-4df2-9c23-fb9ae5536bca","Type":"ContainerStarted","Data":"d8f0289e3c3fd2d9278315abc408becf69ff50efc235ac4a1f0acba0bccee38a"} Jul 30 13:01:12.244001 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:12.243971 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-cj5lq" event={"ID":"30407988-1b56-4ecd-9756-1f503336e72f","Type":"ContainerStarted","Data":"2acf029e3b66b2917aec30a006dbc75ddff7635f945718ede20781b2bc93669b"} Jul 30 13:01:12.870319 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:12.870252 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:01:12.893756 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:12.893712 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5c9ec6ef-6498-4094-8613-fb3a59fa4e24-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-cc2dk\" (UID: \"5c9ec6ef-6498-4094-8613-fb3a59fa4e24\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-cc2dk" Jul 30 13:01:12.896888 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:12.896855 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5c9ec6ef-6498-4094-8613-fb3a59fa4e24-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-cc2dk\" (UID: \"5c9ec6ef-6498-4094-8613-fb3a59fa4e24\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-cc2dk" Jul 30 13:01:12.924798 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:12.924748 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:01:12.994296 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:12.994255 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5703055a-5a1f-4546-bb90-1ca9d22e0933-service-ca-bundle\") pod \"router-default-57f58cdc8c-xn7bm\" (UID: \"5703055a-5a1f-4546-bb90-1ca9d22e0933\") " pod="openshift-ingress/router-default-57f58cdc8c-xn7bm" Jul 30 13:01:12.995066 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:12.995024 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5703055a-5a1f-4546-bb90-1ca9d22e0933-service-ca-bundle\") pod \"router-default-57f58cdc8c-xn7bm\" (UID: \"5703055a-5a1f-4546-bb90-1ca9d22e0933\") " pod="openshift-ingress/router-default-57f58cdc8c-xn7bm" Jul 30 13:01:12.999765 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:12.999743 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-sdt76\"" Jul 30 13:01:13.008271 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:13.008056 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-57f58cdc8c-xn7bm" Jul 30 13:01:13.165637 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:13.165557 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-57f58cdc8c-xn7bm"] Jul 30 13:01:13.169529 ip-10-0-133-230 kubenswrapper[2579]: W0730 13:01:13.169493 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5703055a_5a1f_4546_bb90_1ca9d22e0933.slice/crio-d5dfbb8a0c6311254a8e9b6aade6ca0443336f5dca639c5fa154d92685010501 WatchSource:0}: Error finding container d5dfbb8a0c6311254a8e9b6aade6ca0443336f5dca639c5fa154d92685010501: Status 404 returned error can't find the container with id d5dfbb8a0c6311254a8e9b6aade6ca0443336f5dca639c5fa154d92685010501 Jul 30 13:01:13.193660 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:13.193631 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-qskt6\"" Jul 30 13:01:13.201512 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:13.201360 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-cc2dk" Jul 30 13:01:13.253885 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:13.253265 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-57f58cdc8c-xn7bm" event={"ID":"5703055a-5a1f-4546-bb90-1ca9d22e0933","Type":"ContainerStarted","Data":"19888e1f8f626ff3016ccd714807f235cd309e77486fd19da58ec293a75eb622"} Jul 30 13:01:13.253885 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:13.253366 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-57f58cdc8c-xn7bm" event={"ID":"5703055a-5a1f-4546-bb90-1ca9d22e0933","Type":"ContainerStarted","Data":"d5dfbb8a0c6311254a8e9b6aade6ca0443336f5dca639c5fa154d92685010501"} Jul 30 13:01:13.279870 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:13.279807 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-57f58cdc8c-xn7bm" podStartSLOduration=32.279766859 podStartE2EDuration="32.279766859s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:00:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:01:13.278623399 +0000 UTC m=+121.110089526" watchObservedRunningTime="2026-07-30 13:01:13.279766859 +0000 UTC m=+121.111232984" Jul 30 13:01:13.367338 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:13.367304 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-cc2dk"] Jul 30 13:01:13.373167 ip-10-0-133-230 kubenswrapper[2579]: W0730 13:01:13.373135 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c9ec6ef_6498_4094_8613_fb3a59fa4e24.slice/crio-35ac8f69ec9bce6a792b2529d507cd89967cb6d7d1f087448651ab3594602acd WatchSource:0}: Error finding container 35ac8f69ec9bce6a792b2529d507cd89967cb6d7d1f087448651ab3594602acd: Status 404 returned error can't find the container with id 35ac8f69ec9bce6a792b2529d507cd89967cb6d7d1f087448651ab3594602acd Jul 30 13:01:14.008682 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:14.008635 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-57f58cdc8c-xn7bm" Jul 30 13:01:14.012270 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:14.012232 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-57f58cdc8c-xn7bm" Jul 30 13:01:14.259343 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:14.259210 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-cc2dk" event={"ID":"5c9ec6ef-6498-4094-8613-fb3a59fa4e24","Type":"ContainerStarted","Data":"35ac8f69ec9bce6a792b2529d507cd89967cb6d7d1f087448651ab3594602acd"} Jul 30 13:01:14.259934 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:14.259909 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-57f58cdc8c-xn7bm" Jul 30 13:01:14.261340 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:14.261318 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-57f58cdc8c-xn7bm" Jul 30 13:01:16.269122 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:16.269074 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bq2t2" event={"ID":"7239b730-25c6-4df2-9c23-fb9ae5536bca","Type":"ContainerStarted","Data":"483fb2925e975a56c44a5adf75c3381de665d80a969640f0a3df1440b0878bdd"} Jul 30 13:01:16.288621 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:16.288557 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-bq2t2" podStartSLOduration=17.44413294 podStartE2EDuration="31.28853658s" totalImagesPullingTime="13.84440364s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 13:00:45 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:01:16.286824458 +0000 UTC m=+124.118290587" watchObservedRunningTime="2026-07-30 13:01:16.28853658 +0000 UTC m=+124.120002710" Jul 30 13:01:16.866096 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:16.866054 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:01:16.885171 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:16.885130 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6474f4b7f6-6q9bm"] Jul 30 13:01:16.888458 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:16.888437 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6474f4b7f6-6q9bm" Jul 30 13:01:16.891435 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:16.891389 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 30 13:01:16.891435 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:16.891402 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 30 13:01:16.891597 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:16.891389 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 30 13:01:16.892502 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:16.892481 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-nk55c\"" Jul 30 13:01:16.892650 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:16.892481 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 30 13:01:16.892650 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:16.892604 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 30 13:01:16.899939 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:16.899920 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6474f4b7f6-6q9bm"] Jul 30 13:01:16.928137 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:16.928106 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:01:17.031158 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:17.031115 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2c4d0758-9486-4aee-9f73-85b4b6959665-oauth-serving-cert\") pod \"console-6474f4b7f6-6q9bm\" (UID: \"2c4d0758-9486-4aee-9f73-85b4b6959665\") " pod="openshift-console/console-6474f4b7f6-6q9bm" Jul 30 13:01:17.031348 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:17.031168 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7j5b\" (UniqueName: \"kubernetes.io/projected/2c4d0758-9486-4aee-9f73-85b4b6959665-kube-api-access-x7j5b\") pod \"console-6474f4b7f6-6q9bm\" (UID: \"2c4d0758-9486-4aee-9f73-85b4b6959665\") " pod="openshift-console/console-6474f4b7f6-6q9bm" Jul 30 13:01:17.031348 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:17.031306 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2c4d0758-9486-4aee-9f73-85b4b6959665-console-serving-cert\") pod \"console-6474f4b7f6-6q9bm\" (UID: \"2c4d0758-9486-4aee-9f73-85b4b6959665\") " pod="openshift-console/console-6474f4b7f6-6q9bm" Jul 30 13:01:17.031475 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:17.031348 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2c4d0758-9486-4aee-9f73-85b4b6959665-console-oauth-config\") pod \"console-6474f4b7f6-6q9bm\" (UID: \"2c4d0758-9486-4aee-9f73-85b4b6959665\") " pod="openshift-console/console-6474f4b7f6-6q9bm" Jul 30 13:01:17.031475 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:17.031385 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2c4d0758-9486-4aee-9f73-85b4b6959665-console-config\") pod \"console-6474f4b7f6-6q9bm\" (UID: \"2c4d0758-9486-4aee-9f73-85b4b6959665\") " pod="openshift-console/console-6474f4b7f6-6q9bm" Jul 30 13:01:17.031475 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:17.031446 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2c4d0758-9486-4aee-9f73-85b4b6959665-service-ca\") pod \"console-6474f4b7f6-6q9bm\" (UID: \"2c4d0758-9486-4aee-9f73-85b4b6959665\") " pod="openshift-console/console-6474f4b7f6-6q9bm" Jul 30 13:01:17.132006 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:17.131919 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2c4d0758-9486-4aee-9f73-85b4b6959665-console-serving-cert\") pod \"console-6474f4b7f6-6q9bm\" (UID: \"2c4d0758-9486-4aee-9f73-85b4b6959665\") " pod="openshift-console/console-6474f4b7f6-6q9bm" Jul 30 13:01:17.132006 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:17.131964 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2c4d0758-9486-4aee-9f73-85b4b6959665-console-oauth-config\") pod \"console-6474f4b7f6-6q9bm\" (UID: \"2c4d0758-9486-4aee-9f73-85b4b6959665\") " pod="openshift-console/console-6474f4b7f6-6q9bm" Jul 30 13:01:17.132236 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:17.132028 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2c4d0758-9486-4aee-9f73-85b4b6959665-console-config\") pod \"console-6474f4b7f6-6q9bm\" (UID: \"2c4d0758-9486-4aee-9f73-85b4b6959665\") " pod="openshift-console/console-6474f4b7f6-6q9bm" Jul 30 13:01:17.132236 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:17.132054 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2c4d0758-9486-4aee-9f73-85b4b6959665-service-ca\") pod \"console-6474f4b7f6-6q9bm\" (UID: \"2c4d0758-9486-4aee-9f73-85b4b6959665\") " pod="openshift-console/console-6474f4b7f6-6q9bm" Jul 30 13:01:17.132236 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:17.132103 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2c4d0758-9486-4aee-9f73-85b4b6959665-oauth-serving-cert\") pod \"console-6474f4b7f6-6q9bm\" (UID: \"2c4d0758-9486-4aee-9f73-85b4b6959665\") " pod="openshift-console/console-6474f4b7f6-6q9bm" Jul 30 13:01:17.132236 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:17.132166 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7j5b\" (UniqueName: \"kubernetes.io/projected/2c4d0758-9486-4aee-9f73-85b4b6959665-kube-api-access-x7j5b\") pod \"console-6474f4b7f6-6q9bm\" (UID: \"2c4d0758-9486-4aee-9f73-85b4b6959665\") " pod="openshift-console/console-6474f4b7f6-6q9bm" Jul 30 13:01:17.132968 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:17.132941 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2c4d0758-9486-4aee-9f73-85b4b6959665-oauth-serving-cert\") pod \"console-6474f4b7f6-6q9bm\" (UID: \"2c4d0758-9486-4aee-9f73-85b4b6959665\") " pod="openshift-console/console-6474f4b7f6-6q9bm" Jul 30 13:01:17.133091 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:17.132983 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2c4d0758-9486-4aee-9f73-85b4b6959665-service-ca\") pod \"console-6474f4b7f6-6q9bm\" (UID: \"2c4d0758-9486-4aee-9f73-85b4b6959665\") " pod="openshift-console/console-6474f4b7f6-6q9bm" Jul 30 13:01:17.133091 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:17.133028 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2c4d0758-9486-4aee-9f73-85b4b6959665-console-config\") pod \"console-6474f4b7f6-6q9bm\" (UID: \"2c4d0758-9486-4aee-9f73-85b4b6959665\") " pod="openshift-console/console-6474f4b7f6-6q9bm" Jul 30 13:01:17.135257 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:17.135226 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2c4d0758-9486-4aee-9f73-85b4b6959665-console-oauth-config\") pod \"console-6474f4b7f6-6q9bm\" (UID: \"2c4d0758-9486-4aee-9f73-85b4b6959665\") " pod="openshift-console/console-6474f4b7f6-6q9bm" Jul 30 13:01:17.135375 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:17.135360 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2c4d0758-9486-4aee-9f73-85b4b6959665-console-serving-cert\") pod \"console-6474f4b7f6-6q9bm\" (UID: \"2c4d0758-9486-4aee-9f73-85b4b6959665\") " pod="openshift-console/console-6474f4b7f6-6q9bm" Jul 30 13:01:17.142993 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:17.142969 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7j5b\" (UniqueName: \"kubernetes.io/projected/2c4d0758-9486-4aee-9f73-85b4b6959665-kube-api-access-x7j5b\") pod \"console-6474f4b7f6-6q9bm\" (UID: \"2c4d0758-9486-4aee-9f73-85b4b6959665\") " pod="openshift-console/console-6474f4b7f6-6q9bm" Jul 30 13:01:17.197688 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:17.197660 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6474f4b7f6-6q9bm" Jul 30 13:01:17.219792 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:17.219736 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:01:17.275016 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:17.274984 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-cc2dk" event={"ID":"5c9ec6ef-6498-4094-8613-fb3a59fa4e24","Type":"ContainerStarted","Data":"29a8db1786f29ce35180e2020097845febd34f51675b04dbeaa35c3632745501"} Jul 30 13:01:17.284096 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:17.284067 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:01:17.295764 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:17.294268 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-74c9f884b7-cc2dk" podStartSLOduration=33.320365522 podStartE2EDuration="36.294246715s" totalImagesPullingTime="2.973881193s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:00:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:01:17.292808853 +0000 UTC m=+125.124274982" watchObservedRunningTime="2026-07-30 13:01:17.294246715 +0000 UTC m=+125.125712840" Jul 30 13:01:17.357498 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:17.357461 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6474f4b7f6-6q9bm"] Jul 30 13:01:17.360855 ip-10-0-133-230 kubenswrapper[2579]: W0730 13:01:17.360825 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c4d0758_9486_4aee_9f73_85b4b6959665.slice/crio-94cf6a4a2e48218da2fb0518c2d17b63b5f32bf688f949b6f7581b67fb8e9799 WatchSource:0}: Error finding container 94cf6a4a2e48218da2fb0518c2d17b63b5f32bf688f949b6f7581b67fb8e9799: Status 404 returned error can't find the container with id 94cf6a4a2e48218da2fb0518c2d17b63b5f32bf688f949b6f7581b67fb8e9799 Jul 30 13:01:17.412729 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:17.412640 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:01:17.515297 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:17.515255 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:01:18.281265 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:18.281217 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6474f4b7f6-6q9bm" event={"ID":"2c4d0758-9486-4aee-9f73-85b4b6959665","Type":"ContainerStarted","Data":"94cf6a4a2e48218da2fb0518c2d17b63b5f32bf688f949b6f7581b67fb8e9799"} Jul 30 13:01:19.067503 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:19.067470 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f64975989-wg2rc"] Jul 30 13:01:19.070991 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:19.070965 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f64975989-wg2rc" Jul 30 13:01:19.072333 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:19.072246 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:01:19.081594 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:19.081386 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 30 13:01:19.082724 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:19.082703 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f64975989-wg2rc"] Jul 30 13:01:19.128250 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:19.128170 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:01:19.254460 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:19.254411 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fd91df7-cf89-4e0b-b993-1e4137e59ae3-trusted-ca-bundle\") pod \"console-5f64975989-wg2rc\" (UID: \"2fd91df7-cf89-4e0b-b993-1e4137e59ae3\") " pod="openshift-console/console-5f64975989-wg2rc" Jul 30 13:01:19.254643 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:19.254467 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2fd91df7-cf89-4e0b-b993-1e4137e59ae3-service-ca\") pod \"console-5f64975989-wg2rc\" (UID: \"2fd91df7-cf89-4e0b-b993-1e4137e59ae3\") " pod="openshift-console/console-5f64975989-wg2rc" Jul 30 13:01:19.254643 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:19.254495 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2fd91df7-cf89-4e0b-b993-1e4137e59ae3-console-serving-cert\") pod \"console-5f64975989-wg2rc\" (UID: \"2fd91df7-cf89-4e0b-b993-1e4137e59ae3\") " pod="openshift-console/console-5f64975989-wg2rc" Jul 30 13:01:19.254643 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:19.254520 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2fd91df7-cf89-4e0b-b993-1e4137e59ae3-console-oauth-config\") pod \"console-5f64975989-wg2rc\" (UID: \"2fd91df7-cf89-4e0b-b993-1e4137e59ae3\") " pod="openshift-console/console-5f64975989-wg2rc" Jul 30 13:01:19.254643 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:19.254566 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2fd91df7-cf89-4e0b-b993-1e4137e59ae3-oauth-serving-cert\") pod \"console-5f64975989-wg2rc\" (UID: \"2fd91df7-cf89-4e0b-b993-1e4137e59ae3\") " pod="openshift-console/console-5f64975989-wg2rc" Jul 30 13:01:19.254643 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:19.254629 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p99xr\" (UniqueName: \"kubernetes.io/projected/2fd91df7-cf89-4e0b-b993-1e4137e59ae3-kube-api-access-p99xr\") pod \"console-5f64975989-wg2rc\" (UID: \"2fd91df7-cf89-4e0b-b993-1e4137e59ae3\") " pod="openshift-console/console-5f64975989-wg2rc" Jul 30 13:01:19.254852 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:19.254733 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2fd91df7-cf89-4e0b-b993-1e4137e59ae3-console-config\") pod \"console-5f64975989-wg2rc\" (UID: \"2fd91df7-cf89-4e0b-b993-1e4137e59ae3\") " pod="openshift-console/console-5f64975989-wg2rc" Jul 30 13:01:19.355864 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:19.355764 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fd91df7-cf89-4e0b-b993-1e4137e59ae3-trusted-ca-bundle\") pod \"console-5f64975989-wg2rc\" (UID: \"2fd91df7-cf89-4e0b-b993-1e4137e59ae3\") " pod="openshift-console/console-5f64975989-wg2rc" Jul 30 13:01:19.355864 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:19.355817 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2fd91df7-cf89-4e0b-b993-1e4137e59ae3-service-ca\") pod \"console-5f64975989-wg2rc\" (UID: \"2fd91df7-cf89-4e0b-b993-1e4137e59ae3\") " pod="openshift-console/console-5f64975989-wg2rc" Jul 30 13:01:19.355864 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:19.355846 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2fd91df7-cf89-4e0b-b993-1e4137e59ae3-console-serving-cert\") pod \"console-5f64975989-wg2rc\" (UID: \"2fd91df7-cf89-4e0b-b993-1e4137e59ae3\") " pod="openshift-console/console-5f64975989-wg2rc" Jul 30 13:01:19.356455 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:19.355870 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2fd91df7-cf89-4e0b-b993-1e4137e59ae3-console-oauth-config\") pod \"console-5f64975989-wg2rc\" (UID: \"2fd91df7-cf89-4e0b-b993-1e4137e59ae3\") " pod="openshift-console/console-5f64975989-wg2rc" Jul 30 13:01:19.356455 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:19.355899 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2fd91df7-cf89-4e0b-b993-1e4137e59ae3-oauth-serving-cert\") pod \"console-5f64975989-wg2rc\" (UID: \"2fd91df7-cf89-4e0b-b993-1e4137e59ae3\") " pod="openshift-console/console-5f64975989-wg2rc" Jul 30 13:01:19.356455 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:19.355970 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p99xr\" (UniqueName: \"kubernetes.io/projected/2fd91df7-cf89-4e0b-b993-1e4137e59ae3-kube-api-access-p99xr\") pod \"console-5f64975989-wg2rc\" (UID: \"2fd91df7-cf89-4e0b-b993-1e4137e59ae3\") " pod="openshift-console/console-5f64975989-wg2rc" Jul 30 13:01:19.356633 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:19.356532 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2fd91df7-cf89-4e0b-b993-1e4137e59ae3-console-config\") pod \"console-5f64975989-wg2rc\" (UID: \"2fd91df7-cf89-4e0b-b993-1e4137e59ae3\") " pod="openshift-console/console-5f64975989-wg2rc" Jul 30 13:01:19.356788 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:19.356758 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2fd91df7-cf89-4e0b-b993-1e4137e59ae3-service-ca\") pod \"console-5f64975989-wg2rc\" (UID: \"2fd91df7-cf89-4e0b-b993-1e4137e59ae3\") " pod="openshift-console/console-5f64975989-wg2rc" Jul 30 13:01:19.357010 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:19.356986 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2fd91df7-cf89-4e0b-b993-1e4137e59ae3-oauth-serving-cert\") pod \"console-5f64975989-wg2rc\" (UID: \"2fd91df7-cf89-4e0b-b993-1e4137e59ae3\") " pod="openshift-console/console-5f64975989-wg2rc" Jul 30 13:01:19.357472 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:19.357449 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2fd91df7-cf89-4e0b-b993-1e4137e59ae3-console-config\") pod \"console-5f64975989-wg2rc\" (UID: \"2fd91df7-cf89-4e0b-b993-1e4137e59ae3\") " pod="openshift-console/console-5f64975989-wg2rc" Jul 30 13:01:19.357583 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:19.357545 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fd91df7-cf89-4e0b-b993-1e4137e59ae3-trusted-ca-bundle\") pod \"console-5f64975989-wg2rc\" (UID: \"2fd91df7-cf89-4e0b-b993-1e4137e59ae3\") " pod="openshift-console/console-5f64975989-wg2rc" Jul 30 13:01:19.359111 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:19.359070 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2fd91df7-cf89-4e0b-b993-1e4137e59ae3-console-serving-cert\") pod \"console-5f64975989-wg2rc\" (UID: \"2fd91df7-cf89-4e0b-b993-1e4137e59ae3\") " pod="openshift-console/console-5f64975989-wg2rc" Jul 30 13:01:19.359345 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:19.359323 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2fd91df7-cf89-4e0b-b993-1e4137e59ae3-console-oauth-config\") pod \"console-5f64975989-wg2rc\" (UID: \"2fd91df7-cf89-4e0b-b993-1e4137e59ae3\") " pod="openshift-console/console-5f64975989-wg2rc" Jul 30 13:01:19.365902 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:19.365869 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p99xr\" (UniqueName: \"kubernetes.io/projected/2fd91df7-cf89-4e0b-b993-1e4137e59ae3-kube-api-access-p99xr\") pod \"console-5f64975989-wg2rc\" (UID: \"2fd91df7-cf89-4e0b-b993-1e4137e59ae3\") " pod="openshift-console/console-5f64975989-wg2rc" Jul 30 13:01:19.384528 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:19.384494 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f64975989-wg2rc" Jul 30 13:01:20.566706 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:20.566536 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f64975989-wg2rc"] Jul 30 13:01:20.569725 ip-10-0-133-230 kubenswrapper[2579]: W0730 13:01:20.569700 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fd91df7_cf89_4e0b_b993_1e4137e59ae3.slice/crio-420eefa8d6ff224e681316a78ba9fa254b4219995c40298c110af4bd3c407ea2 WatchSource:0}: Error finding container 420eefa8d6ff224e681316a78ba9fa254b4219995c40298c110af4bd3c407ea2: Status 404 returned error can't find the container with id 420eefa8d6ff224e681316a78ba9fa254b4219995c40298c110af4bd3c407ea2 Jul 30 13:01:21.294031 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:21.293993 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f64975989-wg2rc" event={"ID":"2fd91df7-cf89-4e0b-b993-1e4137e59ae3","Type":"ContainerStarted","Data":"e7d88469ea59b67fcb23111e617f04bbe8852f10585c0d0bcd88c8f632cfc441"} Jul 30 13:01:21.294222 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:21.294049 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f64975989-wg2rc" event={"ID":"2fd91df7-cf89-4e0b-b993-1e4137e59ae3","Type":"ContainerStarted","Data":"420eefa8d6ff224e681316a78ba9fa254b4219995c40298c110af4bd3c407ea2"} Jul 30 13:01:21.295514 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:21.295488 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6474f4b7f6-6q9bm" event={"ID":"2c4d0758-9486-4aee-9f73-85b4b6959665","Type":"ContainerStarted","Data":"9d81101b9f1e5d3628449f1563bb35aeab0b14e5c9447d15322f8ab560d86899"} Jul 30 13:01:21.315075 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:21.315015 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5f64975989-wg2rc" podStartSLOduration=2.314998257 podStartE2EDuration="2.314998257s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:01:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:01:21.313810219 +0000 UTC m=+129.145276344" watchObservedRunningTime="2026-07-30 13:01:21.314998257 +0000 UTC m=+129.146464359" Jul 30 13:01:21.336147 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:21.336084 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6474f4b7f6-6q9bm" podStartSLOduration=2.216491348 podStartE2EDuration="5.336059818s" totalImagesPullingTime="3.11956847s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:01:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:01:21.335140612 +0000 UTC m=+129.166606737" watchObservedRunningTime="2026-07-30 13:01:21.336059818 +0000 UTC m=+129.167525940" Jul 30 13:01:22.489560 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:22.489520 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4467d9b-3531-4231-8fa2-278fec9b2f6d-metrics-certs\") pod \"network-metrics-daemon-mrfm9\" (UID: \"b4467d9b-3531-4231-8fa2-278fec9b2f6d\") " pod="openshift-multus/network-metrics-daemon-mrfm9" Jul 30 13:01:22.492076 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:22.492047 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4467d9b-3531-4231-8fa2-278fec9b2f6d-metrics-certs\") pod \"network-metrics-daemon-mrfm9\" (UID: \"b4467d9b-3531-4231-8fa2-278fec9b2f6d\") " pod="openshift-multus/network-metrics-daemon-mrfm9" Jul 30 13:01:22.524428 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:22.524395 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-v4mfl\"" Jul 30 13:01:22.532360 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:22.532319 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrfm9" Jul 30 13:01:22.709104 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:22.709074 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mrfm9"] Jul 30 13:01:22.712847 ip-10-0-133-230 kubenswrapper[2579]: W0730 13:01:22.712814 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4467d9b_3531_4231_8fa2_278fec9b2f6d.slice/crio-2505d00770330e551ea35ff07d23b7da38925121506c55cb1e633293c41da943 WatchSource:0}: Error finding container 2505d00770330e551ea35ff07d23b7da38925121506c55cb1e633293c41da943: Status 404 returned error can't find the container with id 2505d00770330e551ea35ff07d23b7da38925121506c55cb1e633293c41da943 Jul 30 13:01:23.304647 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:23.304607 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mrfm9" event={"ID":"b4467d9b-3531-4231-8fa2-278fec9b2f6d","Type":"ContainerStarted","Data":"2505d00770330e551ea35ff07d23b7da38925121506c55cb1e633293c41da943"} Jul 30 13:01:23.398969 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:23.398933 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:01:23.497180 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:23.497139 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:01:23.563695 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:23.563604 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-b9vtd"] Jul 30 13:01:23.567038 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:23.567004 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-b9vtd" Jul 30 13:01:23.570345 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:23.570316 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 30 13:01:23.570980 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:23.570957 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-sxnjn\"" Jul 30 13:01:23.576977 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:23.576561 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-b9vtd"] Jul 30 13:01:23.598579 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:23.598547 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:01:23.598804 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:23.598778 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/96d40ad6-d152-445b-bdb8-c78cfca04145-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-b9vtd\" (UID: \"96d40ad6-d152-445b-bdb8-c78cfca04145\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-b9vtd" Jul 30 13:01:23.699796 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:23.699761 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/96d40ad6-d152-445b-bdb8-c78cfca04145-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-b9vtd\" (UID: \"96d40ad6-d152-445b-bdb8-c78cfca04145\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-b9vtd" Jul 30 13:01:23.699986 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:01:23.699927 2579 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 30 13:01:23.700051 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:01:23.700010 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96d40ad6-d152-445b-bdb8-c78cfca04145-tls-certificates podName:96d40ad6-d152-445b-bdb8-c78cfca04145 nodeName:}" failed. No retries permitted until 2026-07-30 13:01:24.199986452 +0000 UTC m=+132.031452558 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/96d40ad6-d152-445b-bdb8-c78cfca04145-tls-certificates") pod "prometheus-operator-admission-webhook-7f8d78f54b-b9vtd" (UID: "96d40ad6-d152-445b-bdb8-c78cfca04145") : secret "prometheus-operator-admission-webhook-tls" not found Jul 30 13:01:23.917605 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:23.917492 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:01:24.204447 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:24.204391 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/96d40ad6-d152-445b-bdb8-c78cfca04145-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-b9vtd\" (UID: \"96d40ad6-d152-445b-bdb8-c78cfca04145\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-b9vtd" Jul 30 13:01:24.207055 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:24.207029 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/96d40ad6-d152-445b-bdb8-c78cfca04145-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-b9vtd\" (UID: \"96d40ad6-d152-445b-bdb8-c78cfca04145\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-b9vtd" Jul 30 13:01:24.479979 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:24.479888 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-b9vtd" Jul 30 13:01:27.197990 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:27.197952 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6474f4b7f6-6q9bm" Jul 30 13:01:27.198484 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:27.198015 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6474f4b7f6-6q9bm" Jul 30 13:01:27.199679 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:27.199644 2579 patch_prober.go:28] interesting pod/console-6474f4b7f6-6q9bm container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.14:8443/health\": dial tcp 10.132.0.14:8443: connect: connection refused" start-of-body= Jul 30 13:01:27.199806 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:27.199708 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6474f4b7f6-6q9bm" podUID="2c4d0758-9486-4aee-9f73-85b4b6959665" containerName="console" probeResult="failure" output="Get \"https://10.132.0.14:8443/health\": dial tcp 10.132.0.14:8443: connect: connection refused" Jul 30 13:01:27.301590 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:27.301540 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:01:27.366998 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:27.366940 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:01:29.385171 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:29.385120 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5f64975989-wg2rc" Jul 30 13:01:29.385648 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:29.385193 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f64975989-wg2rc" Jul 30 13:01:29.386752 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:29.386721 2579 patch_prober.go:28] interesting pod/console-5f64975989-wg2rc container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.15:8443/health\": dial tcp 10.132.0.15:8443: connect: connection refused" start-of-body= Jul 30 13:01:29.386899 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:29.386777 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5f64975989-wg2rc" podUID="2fd91df7-cf89-4e0b-b993-1e4137e59ae3" containerName="console" probeResult="failure" output="Get \"https://10.132.0.15:8443/health\": dial tcp 10.132.0.15:8443: connect: connection refused" Jul 30 13:01:31.401985 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:31.401952 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-b9vtd"] Jul 30 13:01:31.405113 ip-10-0-133-230 kubenswrapper[2579]: W0730 13:01:31.405084 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96d40ad6_d152_445b_bdb8_c78cfca04145.slice/crio-804fe25a5e51d10d74f22b63922daf6d0bdacd370dc62e8413bb35c4c8e52ba9 WatchSource:0}: Error finding container 804fe25a5e51d10d74f22b63922daf6d0bdacd370dc62e8413bb35c4c8e52ba9: Status 404 returned error can't find the container with id 804fe25a5e51d10d74f22b63922daf6d0bdacd370dc62e8413bb35c4c8e52ba9 Jul 30 13:01:32.343800 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:32.343760 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-b9vtd" event={"ID":"96d40ad6-d152-445b-bdb8-c78cfca04145","Type":"ContainerStarted","Data":"804fe25a5e51d10d74f22b63922daf6d0bdacd370dc62e8413bb35c4c8e52ba9"} Jul 30 13:01:32.345644 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:32.345605 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-cj5lq" event={"ID":"30407988-1b56-4ecd-9756-1f503336e72f","Type":"ContainerStarted","Data":"09ecca99f790fcd0c3d9b51d9f0f48d554ff2deab366087b78760b2535412edd"} Jul 30 13:01:32.345795 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:32.345674 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-cj5lq" Jul 30 13:01:32.348046 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:32.347979 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mrfm9" event={"ID":"b4467d9b-3531-4231-8fa2-278fec9b2f6d","Type":"ContainerStarted","Data":"0c0d19b6f49037cc00f42982459877e9137996b8d978f9d1c43ed54c7b82ab81"} Jul 30 13:01:32.348046 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:32.348035 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mrfm9" event={"ID":"b4467d9b-3531-4231-8fa2-278fec9b2f6d","Type":"ContainerStarted","Data":"7647abca32b2d15d2f6a2e86e60eb577a3420509a8e5f72e4eed0f409d540f71"} Jul 30 13:01:32.352339 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:32.352308 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-cj5lq" Jul 30 13:01:32.369986 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:32.369931 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-cj5lq" podStartSLOduration=1.590706887 podStartE2EDuration="21.369906744s" totalImagesPullingTime="19.779199857s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:01:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:01:32.368799043 +0000 UTC m=+140.200265178" watchObservedRunningTime="2026-07-30 13:01:32.369906744 +0000 UTC m=+140.201372871" Jul 30 13:01:32.409729 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:32.409668 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-mrfm9" podStartSLOduration=130.891956581 podStartE2EDuration="2m19.409642968s" totalImagesPullingTime="8.517686387s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 12:59:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:01:32.408240045 +0000 UTC m=+140.239706182" watchObservedRunningTime="2026-07-30 13:01:32.409642968 +0000 UTC m=+140.241109096" Jul 30 13:01:32.518800 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:32.518758 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:01:32.616006 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:32.615884 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:01:32.708012 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:32.707970 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7b957f76f4-w85x4"] Jul 30 13:01:32.708303 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:01:32.708276 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-7b957f76f4-w85x4" podUID="16c04b61-06b6-45f8-a4c6-cb1e1652aa0c" Jul 30 13:01:32.830497 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:32.830450 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:01:32.916188 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:32.916104 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:01:33.353013 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:33.352977 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b957f76f4-w85x4" Jul 30 13:01:33.376955 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:33.376921 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b957f76f4-w85x4" Jul 30 13:01:33.489425 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:33.489374 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/16c04b61-06b6-45f8-a4c6-cb1e1652aa0c-ca-trust-extracted\") pod \"16c04b61-06b6-45f8-a4c6-cb1e1652aa0c\" (UID: \"16c04b61-06b6-45f8-a4c6-cb1e1652aa0c\") " Jul 30 13:01:33.489925 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:33.489438 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-znph7\" (UniqueName: \"kubernetes.io/projected/16c04b61-06b6-45f8-a4c6-cb1e1652aa0c-kube-api-access-znph7\") pod \"16c04b61-06b6-45f8-a4c6-cb1e1652aa0c\" (UID: \"16c04b61-06b6-45f8-a4c6-cb1e1652aa0c\") " Jul 30 13:01:33.489925 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:33.489481 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/16c04b61-06b6-45f8-a4c6-cb1e1652aa0c-registry-certificates\") pod \"16c04b61-06b6-45f8-a4c6-cb1e1652aa0c\" (UID: \"16c04b61-06b6-45f8-a4c6-cb1e1652aa0c\") " Jul 30 13:01:33.489925 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:33.489514 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/16c04b61-06b6-45f8-a4c6-cb1e1652aa0c-trusted-ca\") pod \"16c04b61-06b6-45f8-a4c6-cb1e1652aa0c\" (UID: \"16c04b61-06b6-45f8-a4c6-cb1e1652aa0c\") " Jul 30 13:01:33.489925 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:33.489561 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/16c04b61-06b6-45f8-a4c6-cb1e1652aa0c-installation-pull-secrets\") pod \"16c04b61-06b6-45f8-a4c6-cb1e1652aa0c\" (UID: \"16c04b61-06b6-45f8-a4c6-cb1e1652aa0c\") " Jul 30 13:01:33.489925 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:33.489607 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/16c04b61-06b6-45f8-a4c6-cb1e1652aa0c-bound-sa-token\") pod \"16c04b61-06b6-45f8-a4c6-cb1e1652aa0c\" (UID: \"16c04b61-06b6-45f8-a4c6-cb1e1652aa0c\") " Jul 30 13:01:33.489925 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:33.489640 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/16c04b61-06b6-45f8-a4c6-cb1e1652aa0c-image-registry-private-configuration\") pod \"16c04b61-06b6-45f8-a4c6-cb1e1652aa0c\" (UID: \"16c04b61-06b6-45f8-a4c6-cb1e1652aa0c\") " Jul 30 13:01:33.489925 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:33.489648 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16c04b61-06b6-45f8-a4c6-cb1e1652aa0c-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "16c04b61-06b6-45f8-a4c6-cb1e1652aa0c" (UID: "16c04b61-06b6-45f8-a4c6-cb1e1652aa0c"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 13:01:33.489925 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:33.489821 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16c04b61-06b6-45f8-a4c6-cb1e1652aa0c-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "16c04b61-06b6-45f8-a4c6-cb1e1652aa0c" (UID: "16c04b61-06b6-45f8-a4c6-cb1e1652aa0c"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 13:01:33.489925 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:33.489919 2579 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/16c04b61-06b6-45f8-a4c6-cb1e1652aa0c-ca-trust-extracted\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 13:01:33.489925 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:33.489919 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16c04b61-06b6-45f8-a4c6-cb1e1652aa0c-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "16c04b61-06b6-45f8-a4c6-cb1e1652aa0c" (UID: "16c04b61-06b6-45f8-a4c6-cb1e1652aa0c"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 13:01:33.490458 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:33.489939 2579 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/16c04b61-06b6-45f8-a4c6-cb1e1652aa0c-registry-certificates\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 13:01:33.492511 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:33.492387 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16c04b61-06b6-45f8-a4c6-cb1e1652aa0c-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "16c04b61-06b6-45f8-a4c6-cb1e1652aa0c" (UID: "16c04b61-06b6-45f8-a4c6-cb1e1652aa0c"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 13:01:33.492511 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:33.492492 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16c04b61-06b6-45f8-a4c6-cb1e1652aa0c-kube-api-access-znph7" (OuterVolumeSpecName: "kube-api-access-znph7") pod "16c04b61-06b6-45f8-a4c6-cb1e1652aa0c" (UID: "16c04b61-06b6-45f8-a4c6-cb1e1652aa0c"). InnerVolumeSpecName "kube-api-access-znph7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 13:01:33.492511 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:33.492506 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16c04b61-06b6-45f8-a4c6-cb1e1652aa0c-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "16c04b61-06b6-45f8-a4c6-cb1e1652aa0c" (UID: "16c04b61-06b6-45f8-a4c6-cb1e1652aa0c"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 30 13:01:33.492707 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:33.492616 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16c04b61-06b6-45f8-a4c6-cb1e1652aa0c-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "16c04b61-06b6-45f8-a4c6-cb1e1652aa0c" (UID: "16c04b61-06b6-45f8-a4c6-cb1e1652aa0c"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 30 13:01:33.590796 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:33.590759 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-znph7\" (UniqueName: \"kubernetes.io/projected/16c04b61-06b6-45f8-a4c6-cb1e1652aa0c-kube-api-access-znph7\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 13:01:33.590796 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:33.590792 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/16c04b61-06b6-45f8-a4c6-cb1e1652aa0c-trusted-ca\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 13:01:33.590988 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:33.590808 2579 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/16c04b61-06b6-45f8-a4c6-cb1e1652aa0c-installation-pull-secrets\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 13:01:33.590988 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:33.590822 2579 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/16c04b61-06b6-45f8-a4c6-cb1e1652aa0c-bound-sa-token\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 13:01:33.590988 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:33.590843 2579 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/16c04b61-06b6-45f8-a4c6-cb1e1652aa0c-image-registry-private-configuration\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 13:01:34.364861 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:34.364816 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-b9vtd" event={"ID":"96d40ad6-d152-445b-bdb8-c78cfca04145","Type":"ContainerStarted","Data":"88c7b72f0e0b9faf8577c3c3a720245491a1509823ae74e2ab2f2cc7e55b0f4f"} Jul 30 13:01:34.365139 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:34.364840 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b957f76f4-w85x4" Jul 30 13:01:34.365767 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:34.365252 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-b9vtd" Jul 30 13:01:34.370785 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:34.370759 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-b9vtd" Jul 30 13:01:34.393184 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:34.393127 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-b9vtd" podStartSLOduration=9.251393233 podStartE2EDuration="11.393109712s" totalImagesPullingTime="2.141716479s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:01:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:01:34.392554607 +0000 UTC m=+142.224020733" watchObservedRunningTime="2026-07-30 13:01:34.393109712 +0000 UTC m=+142.224575852" Jul 30 13:01:34.435336 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:34.435301 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7b957f76f4-w85x4"] Jul 30 13:01:34.438012 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:34.437973 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7b957f76f4-w85x4"] Jul 30 13:01:34.498037 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:34.498005 2579 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/16c04b61-06b6-45f8-a4c6-cb1e1652aa0c-registry-tls\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 13:01:34.636096 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:34.635999 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:01:34.692761 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:34.692722 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-vn5xr"] Jul 30 13:01:34.711105 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:34.711074 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-vn5xr" Jul 30 13:01:34.715860 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:34.715832 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-q79wt\"" Jul 30 13:01:34.716024 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:34.715899 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 30 13:01:34.716169 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:34.716146 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 30 13:01:34.716275 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:34.716164 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 30 13:01:34.716388 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:34.716366 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 30 13:01:34.716487 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:34.716470 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 30 13:01:34.717727 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:34.717699 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16c04b61-06b6-45f8-a4c6-cb1e1652aa0c" path="/var/lib/kubelet/pods/16c04b61-06b6-45f8-a4c6-cb1e1652aa0c/volumes" Jul 30 13:01:34.717943 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:34.717926 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-vn5xr"] Jul 30 13:01:34.741639 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:34.741599 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:01:34.800454 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:34.800395 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9b67r\" (UniqueName: \"kubernetes.io/projected/6011c549-7f3f-4bde-a2f3-f430490ef0d0-kube-api-access-9b67r\") pod \"prometheus-operator-84d69f794d-vn5xr\" (UID: \"6011c549-7f3f-4bde-a2f3-f430490ef0d0\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-vn5xr" Jul 30 13:01:34.800659 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:34.800467 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6011c549-7f3f-4bde-a2f3-f430490ef0d0-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-vn5xr\" (UID: \"6011c549-7f3f-4bde-a2f3-f430490ef0d0\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-vn5xr" Jul 30 13:01:34.800659 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:34.800513 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6011c549-7f3f-4bde-a2f3-f430490ef0d0-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-vn5xr\" (UID: \"6011c549-7f3f-4bde-a2f3-f430490ef0d0\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-vn5xr" Jul 30 13:01:34.800659 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:34.800563 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/6011c549-7f3f-4bde-a2f3-f430490ef0d0-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-vn5xr\" (UID: \"6011c549-7f3f-4bde-a2f3-f430490ef0d0\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-vn5xr" Jul 30 13:01:34.837212 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:34.837093 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:01:34.901802 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:34.901711 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6011c549-7f3f-4bde-a2f3-f430490ef0d0-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-vn5xr\" (UID: \"6011c549-7f3f-4bde-a2f3-f430490ef0d0\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-vn5xr" Jul 30 13:01:34.901976 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:34.901878 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/6011c549-7f3f-4bde-a2f3-f430490ef0d0-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-vn5xr\" (UID: \"6011c549-7f3f-4bde-a2f3-f430490ef0d0\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-vn5xr" Jul 30 13:01:34.901976 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:34.901943 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9b67r\" (UniqueName: \"kubernetes.io/projected/6011c549-7f3f-4bde-a2f3-f430490ef0d0-kube-api-access-9b67r\") pod \"prometheus-operator-84d69f794d-vn5xr\" (UID: \"6011c549-7f3f-4bde-a2f3-f430490ef0d0\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-vn5xr" Jul 30 13:01:34.902105 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:34.901975 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6011c549-7f3f-4bde-a2f3-f430490ef0d0-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-vn5xr\" (UID: \"6011c549-7f3f-4bde-a2f3-f430490ef0d0\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-vn5xr" Jul 30 13:01:34.902631 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:34.902601 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6011c549-7f3f-4bde-a2f3-f430490ef0d0-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-vn5xr\" (UID: \"6011c549-7f3f-4bde-a2f3-f430490ef0d0\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-vn5xr" Jul 30 13:01:34.904768 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:34.904742 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6011c549-7f3f-4bde-a2f3-f430490ef0d0-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-vn5xr\" (UID: \"6011c549-7f3f-4bde-a2f3-f430490ef0d0\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-vn5xr" Jul 30 13:01:34.904955 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:34.904887 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/6011c549-7f3f-4bde-a2f3-f430490ef0d0-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-vn5xr\" (UID: \"6011c549-7f3f-4bde-a2f3-f430490ef0d0\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-vn5xr" Jul 30 13:01:34.916638 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:34.916611 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9b67r\" (UniqueName: \"kubernetes.io/projected/6011c549-7f3f-4bde-a2f3-f430490ef0d0-kube-api-access-9b67r\") pod \"prometheus-operator-84d69f794d-vn5xr\" (UID: \"6011c549-7f3f-4bde-a2f3-f430490ef0d0\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-vn5xr" Jul 30 13:01:35.025020 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:35.024981 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-vn5xr" Jul 30 13:01:35.203643 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:35.203621 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-vn5xr"] Jul 30 13:01:35.206639 ip-10-0-133-230 kubenswrapper[2579]: W0730 13:01:35.206606 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6011c549_7f3f_4bde_a2f3_f430490ef0d0.slice/crio-f59f0361d9c5990794abd03a9c200d38fbc7730ee88920f9db16edd60428bfb2 WatchSource:0}: Error finding container f59f0361d9c5990794abd03a9c200d38fbc7730ee88920f9db16edd60428bfb2: Status 404 returned error can't find the container with id f59f0361d9c5990794abd03a9c200d38fbc7730ee88920f9db16edd60428bfb2 Jul 30 13:01:35.370017 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:35.369973 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-vn5xr" event={"ID":"6011c549-7f3f-4bde-a2f3-f430490ef0d0","Type":"ContainerStarted","Data":"f59f0361d9c5990794abd03a9c200d38fbc7730ee88920f9db16edd60428bfb2"} Jul 30 13:01:36.787036 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:36.786949 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:01:36.889085 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:36.889050 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:01:37.151660 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:37.151574 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:01:37.202952 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:37.202919 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6474f4b7f6-6q9bm" Jul 30 13:01:37.207389 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:37.207356 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6474f4b7f6-6q9bm" Jul 30 13:01:37.286634 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:37.286597 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:01:37.861273 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:37.861176 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:01:38.270369 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:38.270319 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:01:38.370958 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:38.370917 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:01:38.386390 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:38.386348 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-vn5xr" event={"ID":"6011c549-7f3f-4bde-a2f3-f430490ef0d0","Type":"ContainerStarted","Data":"39a64c4b5bca9b3bc435bb0d3302c1d6e9910092febf064ee88bdae8c40d13db"} Jul 30 13:01:38.386588 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:38.386466 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-vn5xr" event={"ID":"6011c549-7f3f-4bde-a2f3-f430490ef0d0","Type":"ContainerStarted","Data":"870a67a71f5b2fa66ab4e967b4d1e3134a233167fab8ed1ceac8550492cf389d"} Jul 30 13:01:38.404793 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:38.404733 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-vn5xr" podStartSLOduration=2.143221624 podStartE2EDuration="4.404716658s" totalImagesPullingTime="2.261495034s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:01:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:01:38.404582312 +0000 UTC m=+146.236048438" watchObservedRunningTime="2026-07-30 13:01:38.404716658 +0000 UTC m=+146.236182784" Jul 30 13:01:38.898832 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:38.898790 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:01:38.964623 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:38.964569 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:01:39.389576 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:39.389543 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5f64975989-wg2rc" Jul 30 13:01:39.394103 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:39.394076 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5f64975989-wg2rc" Jul 30 13:01:39.455083 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:39.455047 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6474f4b7f6-6q9bm"] Jul 30 13:01:39.823387 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:39.823349 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:01:39.958872 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:39.958830 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:01:40.071221 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:40.071179 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:01:40.086610 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:40.086533 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-wdgs6"] Jul 30 13:01:40.146075 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:40.146043 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-m9c2p"] Jul 30 13:01:40.146310 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:40.146194 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wdgs6" Jul 30 13:01:40.149261 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:40.149234 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2xgst\"" Jul 30 13:01:40.149522 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:40.149501 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 30 13:01:40.149657 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:40.149639 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 30 13:01:40.149731 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:40.149715 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 30 13:01:40.178227 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:40.178198 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-m9c2p"] Jul 30 13:01:40.178373 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:40.178330 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-m9c2p" Jul 30 13:01:40.181311 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:40.181286 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-gfhns\"" Jul 30 13:01:40.181467 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:40.181315 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 30 13:01:40.181467 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:40.181370 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 30 13:01:40.181467 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:40.181408 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 30 13:01:40.188847 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:40.188821 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:01:40.247151 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:40.247111 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/48618460-2f56-435e-8881-8ef2f4953a3c-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-m9c2p\" (UID: \"48618460-2f56-435e-8881-8ef2f4953a3c\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-m9c2p" Jul 30 13:01:40.247329 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:40.247157 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtl7m\" (UniqueName: \"kubernetes.io/projected/48618460-2f56-435e-8881-8ef2f4953a3c-kube-api-access-mtl7m\") pod \"kube-state-metrics-56d9f944b4-m9c2p\" (UID: \"48618460-2f56-435e-8881-8ef2f4953a3c\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-m9c2p" Jul 30 13:01:40.247329 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:40.247190 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/48618460-2f56-435e-8881-8ef2f4953a3c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-m9c2p\" (UID: \"48618460-2f56-435e-8881-8ef2f4953a3c\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-m9c2p" Jul 30 13:01:40.247329 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:40.247220 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3ca431c8-386a-471a-9828-26f8c576d1b8-node-exporter-accelerators-collector-config\") pod \"node-exporter-wdgs6\" (UID: \"3ca431c8-386a-471a-9828-26f8c576d1b8\") " pod="openshift-monitoring/node-exporter-wdgs6" Jul 30 13:01:40.247329 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:40.247277 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/48618460-2f56-435e-8881-8ef2f4953a3c-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-m9c2p\" (UID: \"48618460-2f56-435e-8881-8ef2f4953a3c\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-m9c2p" Jul 30 13:01:40.247329 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:40.247301 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3ca431c8-386a-471a-9828-26f8c576d1b8-sys\") pod \"node-exporter-wdgs6\" (UID: \"3ca431c8-386a-471a-9828-26f8c576d1b8\") " pod="openshift-monitoring/node-exporter-wdgs6" Jul 30 13:01:40.247594 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:40.247359 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3ca431c8-386a-471a-9828-26f8c576d1b8-node-exporter-textfile\") pod \"node-exporter-wdgs6\" (UID: \"3ca431c8-386a-471a-9828-26f8c576d1b8\") " pod="openshift-monitoring/node-exporter-wdgs6" Jul 30 13:01:40.247594 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:40.247447 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3ca431c8-386a-471a-9828-26f8c576d1b8-node-exporter-tls\") pod \"node-exporter-wdgs6\" (UID: \"3ca431c8-386a-471a-9828-26f8c576d1b8\") " pod="openshift-monitoring/node-exporter-wdgs6" Jul 30 13:01:40.247594 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:40.247476 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7xx9\" (UniqueName: \"kubernetes.io/projected/3ca431c8-386a-471a-9828-26f8c576d1b8-kube-api-access-v7xx9\") pod \"node-exporter-wdgs6\" (UID: \"3ca431c8-386a-471a-9828-26f8c576d1b8\") " pod="openshift-monitoring/node-exporter-wdgs6" Jul 30 13:01:40.247594 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:40.247524 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/48618460-2f56-435e-8881-8ef2f4953a3c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-m9c2p\" (UID: \"48618460-2f56-435e-8881-8ef2f4953a3c\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-m9c2p" Jul 30 13:01:40.247594 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:40.247559 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3ca431c8-386a-471a-9828-26f8c576d1b8-node-exporter-wtmp\") pod \"node-exporter-wdgs6\" (UID: \"3ca431c8-386a-471a-9828-26f8c576d1b8\") " pod="openshift-monitoring/node-exporter-wdgs6" Jul 30 13:01:40.247803 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:40.247597 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/48618460-2f56-435e-8881-8ef2f4953a3c-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-m9c2p\" (UID: \"48618460-2f56-435e-8881-8ef2f4953a3c\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-m9c2p" Jul 30 13:01:40.247803 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:40.247619 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3ca431c8-386a-471a-9828-26f8c576d1b8-metrics-client-ca\") pod \"node-exporter-wdgs6\" (UID: \"3ca431c8-386a-471a-9828-26f8c576d1b8\") " pod="openshift-monitoring/node-exporter-wdgs6" Jul 30 13:01:40.247803 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:40.247687 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3ca431c8-386a-471a-9828-26f8c576d1b8-root\") pod \"node-exporter-wdgs6\" (UID: \"3ca431c8-386a-471a-9828-26f8c576d1b8\") " pod="openshift-monitoring/node-exporter-wdgs6" Jul 30 13:01:40.247803 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:40.247727 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3ca431c8-386a-471a-9828-26f8c576d1b8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wdgs6\" (UID: \"3ca431c8-386a-471a-9828-26f8c576d1b8\") " pod="openshift-monitoring/node-exporter-wdgs6" Jul 30 13:01:40.290635 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:40.290597 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:01:40.348873 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:40.348764 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/48618460-2f56-435e-8881-8ef2f4953a3c-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-m9c2p\" (UID: \"48618460-2f56-435e-8881-8ef2f4953a3c\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-m9c2p" Jul 30 13:01:40.348873 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:40.348821 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtl7m\" (UniqueName: \"kubernetes.io/projected/48618460-2f56-435e-8881-8ef2f4953a3c-kube-api-access-mtl7m\") pod \"kube-state-metrics-56d9f944b4-m9c2p\" (UID: \"48618460-2f56-435e-8881-8ef2f4953a3c\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-m9c2p" Jul 30 13:01:40.348873 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:40.348854 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/48618460-2f56-435e-8881-8ef2f4953a3c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-m9c2p\" (UID: \"48618460-2f56-435e-8881-8ef2f4953a3c\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-m9c2p" Jul 30 13:01:40.348873 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:40.348874 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3ca431c8-386a-471a-9828-26f8c576d1b8-node-exporter-accelerators-collector-config\") pod \"node-exporter-wdgs6\" (UID: \"3ca431c8-386a-471a-9828-26f8c576d1b8\") " pod="openshift-monitoring/node-exporter-wdgs6" Jul 30 13:01:40.349182 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:40.348930 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/48618460-2f56-435e-8881-8ef2f4953a3c-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-m9c2p\" (UID: \"48618460-2f56-435e-8881-8ef2f4953a3c\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-m9c2p" Jul 30 13:01:40.349182 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:40.348958 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3ca431c8-386a-471a-9828-26f8c576d1b8-sys\") pod \"node-exporter-wdgs6\" (UID: \"3ca431c8-386a-471a-9828-26f8c576d1b8\") " pod="openshift-monitoring/node-exporter-wdgs6" Jul 30 13:01:40.349182 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:40.348985 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3ca431c8-386a-471a-9828-26f8c576d1b8-node-exporter-textfile\") pod \"node-exporter-wdgs6\" (UID: \"3ca431c8-386a-471a-9828-26f8c576d1b8\") " pod="openshift-monitoring/node-exporter-wdgs6" Jul 30 13:01:40.349182 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:40.349045 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3ca431c8-386a-471a-9828-26f8c576d1b8-node-exporter-tls\") pod \"node-exporter-wdgs6\" (UID: \"3ca431c8-386a-471a-9828-26f8c576d1b8\") " pod="openshift-monitoring/node-exporter-wdgs6" Jul 30 13:01:40.349182 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:40.349072 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7xx9\" (UniqueName: \"kubernetes.io/projected/3ca431c8-386a-471a-9828-26f8c576d1b8-kube-api-access-v7xx9\") pod \"node-exporter-wdgs6\" (UID: \"3ca431c8-386a-471a-9828-26f8c576d1b8\") " pod="openshift-monitoring/node-exporter-wdgs6" Jul 30 13:01:40.349182 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:40.349112 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/48618460-2f56-435e-8881-8ef2f4953a3c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-m9c2p\" (UID: \"48618460-2f56-435e-8881-8ef2f4953a3c\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-m9c2p" Jul 30 13:01:40.349182 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:40.349138 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3ca431c8-386a-471a-9828-26f8c576d1b8-node-exporter-wtmp\") pod \"node-exporter-wdgs6\" (UID: \"3ca431c8-386a-471a-9828-26f8c576d1b8\") " pod="openshift-monitoring/node-exporter-wdgs6" Jul 30 13:01:40.349182 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:40.349169 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/48618460-2f56-435e-8881-8ef2f4953a3c-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-m9c2p\" (UID: \"48618460-2f56-435e-8881-8ef2f4953a3c\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-m9c2p" Jul 30 13:01:40.349585 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:40.349198 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3ca431c8-386a-471a-9828-26f8c576d1b8-metrics-client-ca\") pod \"node-exporter-wdgs6\" (UID: \"3ca431c8-386a-471a-9828-26f8c576d1b8\") " pod="openshift-monitoring/node-exporter-wdgs6" Jul 30 13:01:40.349585 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:40.349225 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3ca431c8-386a-471a-9828-26f8c576d1b8-sys\") pod \"node-exporter-wdgs6\" (UID: \"3ca431c8-386a-471a-9828-26f8c576d1b8\") " pod="openshift-monitoring/node-exporter-wdgs6" Jul 30 13:01:40.349585 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:40.349236 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3ca431c8-386a-471a-9828-26f8c576d1b8-root\") pod \"node-exporter-wdgs6\" (UID: \"3ca431c8-386a-471a-9828-26f8c576d1b8\") " pod="openshift-monitoring/node-exporter-wdgs6" Jul 30 13:01:40.349585 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:40.349290 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3ca431c8-386a-471a-9828-26f8c576d1b8-root\") pod \"node-exporter-wdgs6\" (UID: \"3ca431c8-386a-471a-9828-26f8c576d1b8\") " pod="openshift-monitoring/node-exporter-wdgs6" Jul 30 13:01:40.349585 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:40.349294 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3ca431c8-386a-471a-9828-26f8c576d1b8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wdgs6\" (UID: \"3ca431c8-386a-471a-9828-26f8c576d1b8\") " pod="openshift-monitoring/node-exporter-wdgs6" Jul 30 13:01:40.349585 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:40.349354 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/48618460-2f56-435e-8881-8ef2f4953a3c-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-m9c2p\" (UID: \"48618460-2f56-435e-8881-8ef2f4953a3c\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-m9c2p" Jul 30 13:01:40.349585 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:01:40.349369 2579 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 30 13:01:40.349585 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:01:40.349467 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ca431c8-386a-471a-9828-26f8c576d1b8-node-exporter-tls podName:3ca431c8-386a-471a-9828-26f8c576d1b8 nodeName:}" failed. No retries permitted until 2026-07-30 13:01:40.849444894 +0000 UTC m=+148.680911014 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/3ca431c8-386a-471a-9828-26f8c576d1b8-node-exporter-tls") pod "node-exporter-wdgs6" (UID: "3ca431c8-386a-471a-9828-26f8c576d1b8") : secret "node-exporter-tls" not found Jul 30 13:01:40.349585 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:40.349359 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3ca431c8-386a-471a-9828-26f8c576d1b8-node-exporter-wtmp\") pod \"node-exporter-wdgs6\" (UID: \"3ca431c8-386a-471a-9828-26f8c576d1b8\") " pod="openshift-monitoring/node-exporter-wdgs6" Jul 30 13:01:40.349585 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:40.349577 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3ca431c8-386a-471a-9828-26f8c576d1b8-node-exporter-accelerators-collector-config\") pod \"node-exporter-wdgs6\" (UID: \"3ca431c8-386a-471a-9828-26f8c576d1b8\") " pod="openshift-monitoring/node-exporter-wdgs6" Jul 30 13:01:40.350077 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:40.349674 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3ca431c8-386a-471a-9828-26f8c576d1b8-node-exporter-textfile\") pod \"node-exporter-wdgs6\" (UID: \"3ca431c8-386a-471a-9828-26f8c576d1b8\") " pod="openshift-monitoring/node-exporter-wdgs6" Jul 30 13:01:40.350077 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:40.350039 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/48618460-2f56-435e-8881-8ef2f4953a3c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-m9c2p\" (UID: \"48618460-2f56-435e-8881-8ef2f4953a3c\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-m9c2p" Jul 30 13:01:40.350077 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:40.350068 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3ca431c8-386a-471a-9828-26f8c576d1b8-metrics-client-ca\") pod \"node-exporter-wdgs6\" (UID: \"3ca431c8-386a-471a-9828-26f8c576d1b8\") " pod="openshift-monitoring/node-exporter-wdgs6" Jul 30 13:01:40.350430 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:40.350379 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/48618460-2f56-435e-8881-8ef2f4953a3c-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-m9c2p\" (UID: \"48618460-2f56-435e-8881-8ef2f4953a3c\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-m9c2p" Jul 30 13:01:40.352112 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:40.352089 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3ca431c8-386a-471a-9828-26f8c576d1b8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wdgs6\" (UID: \"3ca431c8-386a-471a-9828-26f8c576d1b8\") " pod="openshift-monitoring/node-exporter-wdgs6" Jul 30 13:01:40.352291 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:40.352267 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/48618460-2f56-435e-8881-8ef2f4953a3c-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-m9c2p\" (UID: \"48618460-2f56-435e-8881-8ef2f4953a3c\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-m9c2p" Jul 30 13:01:40.352389 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:40.352291 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/48618460-2f56-435e-8881-8ef2f4953a3c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-m9c2p\" (UID: \"48618460-2f56-435e-8881-8ef2f4953a3c\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-m9c2p" Jul 30 13:01:40.358630 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:40.358607 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7xx9\" (UniqueName: \"kubernetes.io/projected/3ca431c8-386a-471a-9828-26f8c576d1b8-kube-api-access-v7xx9\") pod \"node-exporter-wdgs6\" (UID: \"3ca431c8-386a-471a-9828-26f8c576d1b8\") " pod="openshift-monitoring/node-exporter-wdgs6" Jul 30 13:01:40.362068 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:40.362046 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtl7m\" (UniqueName: \"kubernetes.io/projected/48618460-2f56-435e-8881-8ef2f4953a3c-kube-api-access-mtl7m\") pod \"kube-state-metrics-56d9f944b4-m9c2p\" (UID: \"48618460-2f56-435e-8881-8ef2f4953a3c\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-m9c2p" Jul 30 13:01:40.486904 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:40.486861 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:01:40.488548 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:40.488519 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-m9c2p" Jul 30 13:01:40.582242 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:40.582206 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:01:40.688660 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:40.688629 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-m9c2p"] Jul 30 13:01:40.691974 ip-10-0-133-230 kubenswrapper[2579]: W0730 13:01:40.691945 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48618460_2f56_435e_8881_8ef2f4953a3c.slice/crio-538c111d0a3b6b49f7d79d3cf723f14394f5ab63810cc35fb3e8db297b33b9ce WatchSource:0}: Error finding container 538c111d0a3b6b49f7d79d3cf723f14394f5ab63810cc35fb3e8db297b33b9ce: Status 404 returned error can't find the container with id 538c111d0a3b6b49f7d79d3cf723f14394f5ab63810cc35fb3e8db297b33b9ce Jul 30 13:01:40.853735 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:40.853700 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3ca431c8-386a-471a-9828-26f8c576d1b8-node-exporter-tls\") pod \"node-exporter-wdgs6\" (UID: \"3ca431c8-386a-471a-9828-26f8c576d1b8\") " pod="openshift-monitoring/node-exporter-wdgs6" Jul 30 13:01:40.855997 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:40.855970 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3ca431c8-386a-471a-9828-26f8c576d1b8-node-exporter-tls\") pod \"node-exporter-wdgs6\" (UID: \"3ca431c8-386a-471a-9828-26f8c576d1b8\") " pod="openshift-monitoring/node-exporter-wdgs6" Jul 30 13:01:41.043867 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:41.043827 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:01:41.057563 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:41.057523 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wdgs6" Jul 30 13:01:41.094474 ip-10-0-133-230 kubenswrapper[2579]: W0730 13:01:41.094445 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ca431c8_386a_471a_9828_26f8c576d1b8.slice/crio-19ba0cc48254337b71da2eb2b8c1326006f559372ecf80a4a2c2fd62fe5b50e8 WatchSource:0}: Error finding container 19ba0cc48254337b71da2eb2b8c1326006f559372ecf80a4a2c2fd62fe5b50e8: Status 404 returned error can't find the container with id 19ba0cc48254337b71da2eb2b8c1326006f559372ecf80a4a2c2fd62fe5b50e8 Jul 30 13:01:41.129968 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:41.129938 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:01:41.136134 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:41.136104 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 30 13:01:41.159640 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:41.159608 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 30 13:01:41.159788 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:41.159714 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 30 13:01:41.162641 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:41.162617 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 30 13:01:41.162949 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:41.162930 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 30 13:01:41.163057 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:41.162962 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-j7vld\"" Jul 30 13:01:41.163172 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:41.163156 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 30 13:01:41.163258 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:41.163162 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 30 13:01:41.163258 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:41.163239 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 30 13:01:41.163398 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:41.163381 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 30 13:01:41.163520 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:41.163494 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 30 13:01:41.163636 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:41.163498 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 30 13:01:41.163636 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:41.163531 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 30 13:01:41.243961 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:41.243923 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:01:41.256891 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:41.256859 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/728412e0-8766-485c-82d1-221562611c23-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"728412e0-8766-485c-82d1-221562611c23\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 13:01:41.256891 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:41.256895 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/728412e0-8766-485c-82d1-221562611c23-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"728412e0-8766-485c-82d1-221562611c23\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 13:01:41.257080 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:41.256919 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/728412e0-8766-485c-82d1-221562611c23-web-config\") pod \"alertmanager-main-0\" (UID: \"728412e0-8766-485c-82d1-221562611c23\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 13:01:41.257080 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:41.256966 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59pcz\" (UniqueName: \"kubernetes.io/projected/728412e0-8766-485c-82d1-221562611c23-kube-api-access-59pcz\") pod \"alertmanager-main-0\" (UID: \"728412e0-8766-485c-82d1-221562611c23\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 13:01:41.257080 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:41.257003 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/728412e0-8766-485c-82d1-221562611c23-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"728412e0-8766-485c-82d1-221562611c23\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 13:01:41.257080 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:41.257067 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/728412e0-8766-485c-82d1-221562611c23-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"728412e0-8766-485c-82d1-221562611c23\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 13:01:41.257222 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:41.257123 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/728412e0-8766-485c-82d1-221562611c23-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"728412e0-8766-485c-82d1-221562611c23\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 13:01:41.257222 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:41.257148 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/728412e0-8766-485c-82d1-221562611c23-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"728412e0-8766-485c-82d1-221562611c23\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 13:01:41.257222 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:41.257197 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/728412e0-8766-485c-82d1-221562611c23-config-volume\") pod \"alertmanager-main-0\" (UID: \"728412e0-8766-485c-82d1-221562611c23\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 13:01:41.257324 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:41.257227 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/728412e0-8766-485c-82d1-221562611c23-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"728412e0-8766-485c-82d1-221562611c23\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 13:01:41.257324 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:41.257263 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/728412e0-8766-485c-82d1-221562611c23-tls-assets\") pod \"alertmanager-main-0\" (UID: \"728412e0-8766-485c-82d1-221562611c23\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 13:01:41.257324 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:41.257309 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/728412e0-8766-485c-82d1-221562611c23-config-out\") pod \"alertmanager-main-0\" (UID: \"728412e0-8766-485c-82d1-221562611c23\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 13:01:41.257448 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:41.257333 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/728412e0-8766-485c-82d1-221562611c23-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"728412e0-8766-485c-82d1-221562611c23\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 13:01:41.358001 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:41.357905 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/728412e0-8766-485c-82d1-221562611c23-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"728412e0-8766-485c-82d1-221562611c23\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 13:01:41.358001 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:41.357955 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/728412e0-8766-485c-82d1-221562611c23-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"728412e0-8766-485c-82d1-221562611c23\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 13:01:41.358226 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:41.358169 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/728412e0-8766-485c-82d1-221562611c23-config-volume\") pod \"alertmanager-main-0\" (UID: \"728412e0-8766-485c-82d1-221562611c23\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 13:01:41.358286 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:41.358255 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/728412e0-8766-485c-82d1-221562611c23-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"728412e0-8766-485c-82d1-221562611c23\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 13:01:41.358343 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:41.358314 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/728412e0-8766-485c-82d1-221562611c23-tls-assets\") pod \"alertmanager-main-0\" (UID: \"728412e0-8766-485c-82d1-221562611c23\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 13:01:41.358400 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:41.358363 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/728412e0-8766-485c-82d1-221562611c23-config-out\") pod \"alertmanager-main-0\" (UID: \"728412e0-8766-485c-82d1-221562611c23\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 13:01:41.358400 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:41.358390 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/728412e0-8766-485c-82d1-221562611c23-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"728412e0-8766-485c-82d1-221562611c23\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 13:01:41.358528 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:41.358454 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/728412e0-8766-485c-82d1-221562611c23-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"728412e0-8766-485c-82d1-221562611c23\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 13:01:41.358528 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:41.358485 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/728412e0-8766-485c-82d1-221562611c23-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"728412e0-8766-485c-82d1-221562611c23\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 13:01:41.358528 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:41.358518 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/728412e0-8766-485c-82d1-221562611c23-web-config\") pod \"alertmanager-main-0\" (UID: \"728412e0-8766-485c-82d1-221562611c23\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 13:01:41.358673 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:41.358541 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59pcz\" (UniqueName: \"kubernetes.io/projected/728412e0-8766-485c-82d1-221562611c23-kube-api-access-59pcz\") pod \"alertmanager-main-0\" (UID: \"728412e0-8766-485c-82d1-221562611c23\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 13:01:41.358673 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:41.358577 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/728412e0-8766-485c-82d1-221562611c23-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"728412e0-8766-485c-82d1-221562611c23\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 13:01:41.358673 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:41.358618 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/728412e0-8766-485c-82d1-221562611c23-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"728412e0-8766-485c-82d1-221562611c23\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 13:01:41.359779 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:41.358935 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/728412e0-8766-485c-82d1-221562611c23-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"728412e0-8766-485c-82d1-221562611c23\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 13:01:41.359779 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:41.359384 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/728412e0-8766-485c-82d1-221562611c23-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"728412e0-8766-485c-82d1-221562611c23\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 13:01:41.360835 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:41.360779 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/728412e0-8766-485c-82d1-221562611c23-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"728412e0-8766-485c-82d1-221562611c23\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 13:01:41.361946 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:41.361918 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/728412e0-8766-485c-82d1-221562611c23-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"728412e0-8766-485c-82d1-221562611c23\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 13:01:41.363046 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:41.362996 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/728412e0-8766-485c-82d1-221562611c23-config-volume\") pod \"alertmanager-main-0\" (UID: \"728412e0-8766-485c-82d1-221562611c23\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 13:01:41.363771 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:41.363196 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/728412e0-8766-485c-82d1-221562611c23-tls-assets\") pod \"alertmanager-main-0\" (UID: \"728412e0-8766-485c-82d1-221562611c23\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 13:01:41.363771 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:41.363690 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/728412e0-8766-485c-82d1-221562611c23-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"728412e0-8766-485c-82d1-221562611c23\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 13:01:41.363771 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:41.363710 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/728412e0-8766-485c-82d1-221562611c23-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"728412e0-8766-485c-82d1-221562611c23\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 13:01:41.363771 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:41.363733 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/728412e0-8766-485c-82d1-221562611c23-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"728412e0-8766-485c-82d1-221562611c23\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 13:01:41.364202 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:41.364118 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/728412e0-8766-485c-82d1-221562611c23-config-out\") pod \"alertmanager-main-0\" (UID: \"728412e0-8766-485c-82d1-221562611c23\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 13:01:41.364202 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:41.364156 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/728412e0-8766-485c-82d1-221562611c23-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"728412e0-8766-485c-82d1-221562611c23\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 13:01:41.366155 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:41.366128 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/728412e0-8766-485c-82d1-221562611c23-web-config\") pod \"alertmanager-main-0\" (UID: \"728412e0-8766-485c-82d1-221562611c23\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 13:01:41.369705 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:41.369675 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59pcz\" (UniqueName: \"kubernetes.io/projected/728412e0-8766-485c-82d1-221562611c23-kube-api-access-59pcz\") pod \"alertmanager-main-0\" (UID: \"728412e0-8766-485c-82d1-221562611c23\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 13:01:41.401091 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:41.401049 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wdgs6" event={"ID":"3ca431c8-386a-471a-9828-26f8c576d1b8","Type":"ContainerStarted","Data":"19ba0cc48254337b71da2eb2b8c1326006f559372ecf80a4a2c2fd62fe5b50e8"} Jul 30 13:01:41.402341 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:41.402311 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-m9c2p" event={"ID":"48618460-2f56-435e-8881-8ef2f4953a3c","Type":"ContainerStarted","Data":"538c111d0a3b6b49f7d79d3cf723f14394f5ab63810cc35fb3e8db297b33b9ce"} Jul 30 13:01:41.469653 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:41.469616 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 30 13:01:41.650821 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:41.650710 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 30 13:01:41.654575 ip-10-0-133-230 kubenswrapper[2579]: W0730 13:01:41.654548 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod728412e0_8766_485c_82d1_221562611c23.slice/crio-fc46c31dbafcca7dd8dfd4a0332bdbe04513b340eec16a3d723aaa9fd92ba8dc WatchSource:0}: Error finding container fc46c31dbafcca7dd8dfd4a0332bdbe04513b340eec16a3d723aaa9fd92ba8dc: Status 404 returned error can't find the container with id fc46c31dbafcca7dd8dfd4a0332bdbe04513b340eec16a3d723aaa9fd92ba8dc Jul 30 13:01:42.335711 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:42.335677 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:01:42.407238 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:42.407205 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"728412e0-8766-485c-82d1-221562611c23","Type":"ContainerStarted","Data":"fc46c31dbafcca7dd8dfd4a0332bdbe04513b340eec16a3d723aaa9fd92ba8dc"} Jul 30 13:01:42.447674 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:42.447638 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:01:42.997465 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:42.997393 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:01:43.100337 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:43.100297 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:01:43.284224 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:43.284172 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:01:43.349261 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:43.349212 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:01:43.410032 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:43.409882 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:01:43.414515 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:43.414483 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-m9c2p" event={"ID":"48618460-2f56-435e-8881-8ef2f4953a3c","Type":"ContainerStarted","Data":"820985692f0254bd556d9df5ec0d8e4078ab047f0e038c35eeadeb4d54df79d9"} Jul 30 13:01:43.468911 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:43.468869 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:01:44.236222 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:44.236182 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:01:44.318213 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:44.318176 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:01:44.420394 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:44.420361 2579 generic.go:356] "Generic (PLEG): container finished" podID="3ca431c8-386a-471a-9828-26f8c576d1b8" containerID="911819bd576c1f7eb9c7e3cf3cd56d82e5df868beb0b6fae16d7073c9fd654fc" exitCode=0 Jul 30 13:01:44.420934 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:44.420453 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wdgs6" event={"ID":"3ca431c8-386a-471a-9828-26f8c576d1b8","Type":"ContainerDied","Data":"911819bd576c1f7eb9c7e3cf3cd56d82e5df868beb0b6fae16d7073c9fd654fc"} Jul 30 13:01:44.424243 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:44.424216 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-m9c2p" event={"ID":"48618460-2f56-435e-8881-8ef2f4953a3c","Type":"ContainerStarted","Data":"d0f3e07981ccb32862331dc07ce6478459ca090ec3cdcece972a8831bb5d8ffd"} Jul 30 13:01:44.424350 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:44.424268 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-m9c2p" event={"ID":"48618460-2f56-435e-8881-8ef2f4953a3c","Type":"ContainerStarted","Data":"84d181bf1e77170d579148372d3f44ab6af909f8e075c68a5cd5ddb013ae4a64"} Jul 30 13:01:44.425917 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:44.425896 2579 generic.go:356] "Generic (PLEG): container finished" podID="728412e0-8766-485c-82d1-221562611c23" containerID="14f661bec38ad99bb283cae0893e0c50bb2bd448b6985aa83410959c6e43fdc6" exitCode=0 Jul 30 13:01:44.426006 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:44.425932 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"728412e0-8766-485c-82d1-221562611c23","Type":"ContainerDied","Data":"14f661bec38ad99bb283cae0893e0c50bb2bd448b6985aa83410959c6e43fdc6"} Jul 30 13:01:44.459705 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:44.459663 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-m9c2p" podStartSLOduration=2.273529683 podStartE2EDuration="4.459646796s" totalImagesPullingTime="2.186117113s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:01:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:01:44.459128767 +0000 UTC m=+152.290594893" watchObservedRunningTime="2026-07-30 13:01:44.459646796 +0000 UTC m=+152.291112963" Jul 30 13:01:44.830929 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:44.830851 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:01:44.846795 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:44.846762 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6946f8bb4c-6m6xl"] Jul 30 13:01:44.867340 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:44.867304 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6946f8bb4c-6m6xl"] Jul 30 13:01:44.867499 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:44.867451 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6946f8bb4c-6m6xl" Jul 30 13:01:44.899100 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:44.899069 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:01:44.992059 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:44.992027 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e1afa3d9-e3f9-4687-b654-68c58daa1979-oauth-serving-cert\") pod \"console-6946f8bb4c-6m6xl\" (UID: \"e1afa3d9-e3f9-4687-b654-68c58daa1979\") " pod="openshift-console/console-6946f8bb4c-6m6xl" Jul 30 13:01:44.992059 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:44.992063 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e1afa3d9-e3f9-4687-b654-68c58daa1979-service-ca\") pod \"console-6946f8bb4c-6m6xl\" (UID: \"e1afa3d9-e3f9-4687-b654-68c58daa1979\") " pod="openshift-console/console-6946f8bb4c-6m6xl" Jul 30 13:01:44.992294 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:44.992094 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e1afa3d9-e3f9-4687-b654-68c58daa1979-trusted-ca-bundle\") pod \"console-6946f8bb4c-6m6xl\" (UID: \"e1afa3d9-e3f9-4687-b654-68c58daa1979\") " pod="openshift-console/console-6946f8bb4c-6m6xl" Jul 30 13:01:44.992294 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:44.992133 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e1afa3d9-e3f9-4687-b654-68c58daa1979-console-config\") pod \"console-6946f8bb4c-6m6xl\" (UID: \"e1afa3d9-e3f9-4687-b654-68c58daa1979\") " pod="openshift-console/console-6946f8bb4c-6m6xl" Jul 30 13:01:44.992294 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:44.992159 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e1afa3d9-e3f9-4687-b654-68c58daa1979-console-serving-cert\") pod \"console-6946f8bb4c-6m6xl\" (UID: \"e1afa3d9-e3f9-4687-b654-68c58daa1979\") " pod="openshift-console/console-6946f8bb4c-6m6xl" Jul 30 13:01:44.992294 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:44.992216 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e1afa3d9-e3f9-4687-b654-68c58daa1979-console-oauth-config\") pod \"console-6946f8bb4c-6m6xl\" (UID: \"e1afa3d9-e3f9-4687-b654-68c58daa1979\") " pod="openshift-console/console-6946f8bb4c-6m6xl" Jul 30 13:01:44.992294 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:44.992254 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7jd4\" (UniqueName: \"kubernetes.io/projected/e1afa3d9-e3f9-4687-b654-68c58daa1979-kube-api-access-k7jd4\") pod \"console-6946f8bb4c-6m6xl\" (UID: \"e1afa3d9-e3f9-4687-b654-68c58daa1979\") " pod="openshift-console/console-6946f8bb4c-6m6xl" Jul 30 13:01:45.002784 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:45.002755 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:01:45.063841 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:45.063807 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:01:45.092791 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:45.092715 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e1afa3d9-e3f9-4687-b654-68c58daa1979-trusted-ca-bundle\") pod \"console-6946f8bb4c-6m6xl\" (UID: \"e1afa3d9-e3f9-4687-b654-68c58daa1979\") " pod="openshift-console/console-6946f8bb4c-6m6xl" Jul 30 13:01:45.092791 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:45.092765 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e1afa3d9-e3f9-4687-b654-68c58daa1979-console-config\") pod \"console-6946f8bb4c-6m6xl\" (UID: \"e1afa3d9-e3f9-4687-b654-68c58daa1979\") " pod="openshift-console/console-6946f8bb4c-6m6xl" Jul 30 13:01:45.092791 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:45.092789 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e1afa3d9-e3f9-4687-b654-68c58daa1979-console-serving-cert\") pod \"console-6946f8bb4c-6m6xl\" (UID: \"e1afa3d9-e3f9-4687-b654-68c58daa1979\") " pod="openshift-console/console-6946f8bb4c-6m6xl" Jul 30 13:01:45.092995 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:45.092806 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e1afa3d9-e3f9-4687-b654-68c58daa1979-console-oauth-config\") pod \"console-6946f8bb4c-6m6xl\" (UID: \"e1afa3d9-e3f9-4687-b654-68c58daa1979\") " pod="openshift-console/console-6946f8bb4c-6m6xl" Jul 30 13:01:45.092995 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:45.092827 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7jd4\" (UniqueName: \"kubernetes.io/projected/e1afa3d9-e3f9-4687-b654-68c58daa1979-kube-api-access-k7jd4\") pod \"console-6946f8bb4c-6m6xl\" (UID: \"e1afa3d9-e3f9-4687-b654-68c58daa1979\") " pod="openshift-console/console-6946f8bb4c-6m6xl" Jul 30 13:01:45.092995 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:45.092888 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e1afa3d9-e3f9-4687-b654-68c58daa1979-oauth-serving-cert\") pod \"console-6946f8bb4c-6m6xl\" (UID: \"e1afa3d9-e3f9-4687-b654-68c58daa1979\") " pod="openshift-console/console-6946f8bb4c-6m6xl" Jul 30 13:01:45.093115 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:45.093074 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e1afa3d9-e3f9-4687-b654-68c58daa1979-service-ca\") pod \"console-6946f8bb4c-6m6xl\" (UID: \"e1afa3d9-e3f9-4687-b654-68c58daa1979\") " pod="openshift-console/console-6946f8bb4c-6m6xl" Jul 30 13:01:45.093656 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:45.093625 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e1afa3d9-e3f9-4687-b654-68c58daa1979-console-config\") pod \"console-6946f8bb4c-6m6xl\" (UID: \"e1afa3d9-e3f9-4687-b654-68c58daa1979\") " pod="openshift-console/console-6946f8bb4c-6m6xl" Jul 30 13:01:45.093802 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:45.093686 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e1afa3d9-e3f9-4687-b654-68c58daa1979-trusted-ca-bundle\") pod \"console-6946f8bb4c-6m6xl\" (UID: \"e1afa3d9-e3f9-4687-b654-68c58daa1979\") " pod="openshift-console/console-6946f8bb4c-6m6xl" Jul 30 13:01:45.093802 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:45.093706 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e1afa3d9-e3f9-4687-b654-68c58daa1979-oauth-serving-cert\") pod \"console-6946f8bb4c-6m6xl\" (UID: \"e1afa3d9-e3f9-4687-b654-68c58daa1979\") " pod="openshift-console/console-6946f8bb4c-6m6xl" Jul 30 13:01:45.093802 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:45.093770 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e1afa3d9-e3f9-4687-b654-68c58daa1979-service-ca\") pod \"console-6946f8bb4c-6m6xl\" (UID: \"e1afa3d9-e3f9-4687-b654-68c58daa1979\") " pod="openshift-console/console-6946f8bb4c-6m6xl" Jul 30 13:01:45.095359 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:45.095336 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e1afa3d9-e3f9-4687-b654-68c58daa1979-console-serving-cert\") pod \"console-6946f8bb4c-6m6xl\" (UID: \"e1afa3d9-e3f9-4687-b654-68c58daa1979\") " pod="openshift-console/console-6946f8bb4c-6m6xl" Jul 30 13:01:45.095458 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:45.095369 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e1afa3d9-e3f9-4687-b654-68c58daa1979-console-oauth-config\") pod \"console-6946f8bb4c-6m6xl\" (UID: \"e1afa3d9-e3f9-4687-b654-68c58daa1979\") " pod="openshift-console/console-6946f8bb4c-6m6xl" Jul 30 13:01:45.101595 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:45.101576 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7jd4\" (UniqueName: \"kubernetes.io/projected/e1afa3d9-e3f9-4687-b654-68c58daa1979-kube-api-access-k7jd4\") pod \"console-6946f8bb4c-6m6xl\" (UID: \"e1afa3d9-e3f9-4687-b654-68c58daa1979\") " pod="openshift-console/console-6946f8bb4c-6m6xl" Jul 30 13:01:45.177244 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:45.177197 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6946f8bb4c-6m6xl" Jul 30 13:01:45.350299 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:45.350221 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6946f8bb4c-6m6xl"] Jul 30 13:01:45.353936 ip-10-0-133-230 kubenswrapper[2579]: W0730 13:01:45.353909 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1afa3d9_e3f9_4687_b654_68c58daa1979.slice/crio-79fcc1afbb615a2ee6375b54b2d7ad24bf5135862726e70b47f4764f056e615b WatchSource:0}: Error finding container 79fcc1afbb615a2ee6375b54b2d7ad24bf5135862726e70b47f4764f056e615b: Status 404 returned error can't find the container with id 79fcc1afbb615a2ee6375b54b2d7ad24bf5135862726e70b47f4764f056e615b Jul 30 13:01:45.431047 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:45.431021 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6946f8bb4c-6m6xl" event={"ID":"e1afa3d9-e3f9-4687-b654-68c58daa1979","Type":"ContainerStarted","Data":"79fcc1afbb615a2ee6375b54b2d7ad24bf5135862726e70b47f4764f056e615b"} Jul 30 13:01:45.433044 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:45.433019 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wdgs6" event={"ID":"3ca431c8-386a-471a-9828-26f8c576d1b8","Type":"ContainerStarted","Data":"fb3afa59b066c0cce69684b5c46301560283677b43859384e4b6476961c1de3b"} Jul 30 13:01:45.433142 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:45.433066 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wdgs6" event={"ID":"3ca431c8-386a-471a-9828-26f8c576d1b8","Type":"ContainerStarted","Data":"4cbf8daac222f4756e887860f9b83252c0dc84cd28ff2223a4cebd331a59ec73"} Jul 30 13:01:45.453781 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:45.453730 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-wdgs6" podStartSLOduration=2.934885119 podStartE2EDuration="5.453710038s" totalImagesPullingTime="2.434975223s" totalInitContainerRuntime="83.849696ms" isStatefulPod=true podCreationTimestamp="2026-07-30 13:01:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:01:45.452833573 +0000 UTC m=+153.284299697" watchObservedRunningTime="2026-07-30 13:01:45.453710038 +0000 UTC m=+153.285176171" Jul 30 13:01:45.842925 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:45.842887 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:01:45.943008 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:45.942969 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:01:46.439435 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:46.439386 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6946f8bb4c-6m6xl" event={"ID":"e1afa3d9-e3f9-4687-b654-68c58daa1979","Type":"ContainerStarted","Data":"bb07e09737a4818f852d7e9af5994d5ce5cfe04c60ce2d0639d1af56425b1757"} Jul 30 13:01:46.466145 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:46.466104 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:01:46.473096 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:46.473032 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6946f8bb4c-6m6xl" podStartSLOduration=2.473016526 podStartE2EDuration="2.473016526s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:01:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:01:46.472372439 +0000 UTC m=+154.303838563" watchObservedRunningTime="2026-07-30 13:01:46.473016526 +0000 UTC m=+154.304482650" Jul 30 13:01:47.446803 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:47.446764 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"728412e0-8766-485c-82d1-221562611c23","Type":"ContainerStarted","Data":"6bffdfa987381a934860999a30a37ed4ef32853ae048b4db0ebfb8a7dd7e4d00"} Jul 30 13:01:47.447189 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:47.446828 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"728412e0-8766-485c-82d1-221562611c23","Type":"ContainerStarted","Data":"0526770276b7c0ceac5bfd9e5d97a2f979db34874c1b137b6a62b94edb7f10ce"} Jul 30 13:01:47.447189 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:47.446859 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"728412e0-8766-485c-82d1-221562611c23","Type":"ContainerStarted","Data":"fc7f6c379fc078a621dd4789b41be1e9deb3a0e5b77b13bf3f9ac7e82f8b7b18"} Jul 30 13:01:47.447189 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:47.446890 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"728412e0-8766-485c-82d1-221562611c23","Type":"ContainerStarted","Data":"5c159eacc16afefaab8c7d4bb7935ae56222ffb6173c7ffef2ba7e7f18dd810b"} Jul 30 13:01:47.447189 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:47.446919 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"728412e0-8766-485c-82d1-221562611c23","Type":"ContainerStarted","Data":"81c1cffc067b4060c8719dbdf9c3b588776553356965d9c7fb08acc23a34d32a"} Jul 30 13:01:48.905690 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:48.905639 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:01:49.006216 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:49.006186 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:01:49.458650 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:49.458613 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"728412e0-8766-485c-82d1-221562611c23","Type":"ContainerStarted","Data":"58852207eb766a48dd0b125313488d0744ea3950ea2da086ab2eab6795a9eb96"} Jul 30 13:01:49.489149 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:49.489078 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.3960488 podStartE2EDuration="8.489063408s" totalImagesPullingTime="6.074149103s" totalInitContainerRuntime="18.865505ms" isStatefulPod=false podCreationTimestamp="2026-07-30 13:01:41 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:01:49.488801521 +0000 UTC m=+157.320267661" watchObservedRunningTime="2026-07-30 13:01:49.489063408 +0000 UTC m=+157.320529534" Jul 30 13:01:50.119049 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:01:50.119012 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-598js" podUID="a34ce5ce-94cf-4ab0-923d-c12612130e0a" Jul 30 13:01:50.461902 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:50.461868 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-598js" Jul 30 13:01:51.440353 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:51.440301 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:01:51.512453 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:51.512400 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:01:52.182819 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:52.182779 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:01:52.281980 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:52.281940 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:01:55.089212 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:55.089174 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a34ce5ce-94cf-4ab0-923d-c12612130e0a-metrics-tls\") pod \"dns-default-598js\" (UID: \"a34ce5ce-94cf-4ab0-923d-c12612130e0a\") " pod="openshift-dns/dns-default-598js" Jul 30 13:01:55.091538 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:55.091514 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a34ce5ce-94cf-4ab0-923d-c12612130e0a-metrics-tls\") pod \"dns-default-598js\" (UID: \"a34ce5ce-94cf-4ab0-923d-c12612130e0a\") " pod="openshift-dns/dns-default-598js" Jul 30 13:01:55.177605 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:55.177571 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6946f8bb4c-6m6xl" Jul 30 13:01:55.177766 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:55.177653 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6946f8bb4c-6m6xl" Jul 30 13:01:55.182966 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:55.182944 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6946f8bb4c-6m6xl" Jul 30 13:01:55.265547 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:55.265518 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lv78x\"" Jul 30 13:01:55.273878 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:55.273854 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-598js" Jul 30 13:01:55.433068 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:55.433035 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-598js"] Jul 30 13:01:55.436117 ip-10-0-133-230 kubenswrapper[2579]: W0730 13:01:55.436086 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda34ce5ce_94cf_4ab0_923d_c12612130e0a.slice/crio-478122ac0d6eeb64bcd80c72a6bef9ab1e6a25a323fd367dd102e103a31775db WatchSource:0}: Error finding container 478122ac0d6eeb64bcd80c72a6bef9ab1e6a25a323fd367dd102e103a31775db: Status 404 returned error can't find the container with id 478122ac0d6eeb64bcd80c72a6bef9ab1e6a25a323fd367dd102e103a31775db Jul 30 13:01:55.486111 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:55.486079 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-598js" event={"ID":"a34ce5ce-94cf-4ab0-923d-c12612130e0a","Type":"ContainerStarted","Data":"478122ac0d6eeb64bcd80c72a6bef9ab1e6a25a323fd367dd102e103a31775db"} Jul 30 13:01:55.490090 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:55.490063 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6946f8bb4c-6m6xl" Jul 30 13:01:55.592244 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:55.592212 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f64975989-wg2rc"] Jul 30 13:01:55.733715 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:55.733687 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:01:55.936698 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:55.936654 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:01:56.035328 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:56.035248 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:01:58.499723 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:58.499689 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-598js" event={"ID":"a34ce5ce-94cf-4ab0-923d-c12612130e0a","Type":"ContainerStarted","Data":"9d6502a87a759bf756cf62ea8b0910c8e5f5c585278018f81297e39a57e62fca"} Jul 30 13:01:58.500203 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:58.499741 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-598js" event={"ID":"a34ce5ce-94cf-4ab0-923d-c12612130e0a","Type":"ContainerStarted","Data":"59ee605ffccfa56d92fa3fcfbc30bb2a1898a151d1596c4bc384003cfdde54bc"} Jul 30 13:01:58.500203 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:58.499764 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-598js" Jul 30 13:01:58.518014 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:01:58.517962 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-598js" podStartSLOduration=129.11907608 podStartE2EDuration="2m11.517948618s" totalImagesPullingTime="2.398872538s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 12:59:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:01:58.517359656 +0000 UTC m=+166.348825824" watchObservedRunningTime="2026-07-30 13:01:58.517948618 +0000 UTC m=+166.349414742" Jul 30 13:02:04.478476 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:02:04.478399 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6474f4b7f6-6q9bm" podUID="2c4d0758-9486-4aee-9f73-85b4b6959665" containerName="console" containerID="cri-o://9d81101b9f1e5d3628449f1563bb35aeab0b14e5c9447d15322f8ab560d86899" gracePeriod=15 Jul 30 13:02:04.758442 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:02:04.758354 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6474f4b7f6-6q9bm" Jul 30 13:02:04.774455 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:02:04.774427 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x7j5b\" (UniqueName: \"kubernetes.io/projected/2c4d0758-9486-4aee-9f73-85b4b6959665-kube-api-access-x7j5b\") pod \"2c4d0758-9486-4aee-9f73-85b4b6959665\" (UID: \"2c4d0758-9486-4aee-9f73-85b4b6959665\") " Jul 30 13:02:04.774613 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:02:04.774485 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2c4d0758-9486-4aee-9f73-85b4b6959665-console-oauth-config\") pod \"2c4d0758-9486-4aee-9f73-85b4b6959665\" (UID: \"2c4d0758-9486-4aee-9f73-85b4b6959665\") " Jul 30 13:02:04.774613 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:02:04.774577 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2c4d0758-9486-4aee-9f73-85b4b6959665-console-config\") pod \"2c4d0758-9486-4aee-9f73-85b4b6959665\" (UID: \"2c4d0758-9486-4aee-9f73-85b4b6959665\") " Jul 30 13:02:04.774613 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:02:04.774609 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2c4d0758-9486-4aee-9f73-85b4b6959665-console-serving-cert\") pod \"2c4d0758-9486-4aee-9f73-85b4b6959665\" (UID: \"2c4d0758-9486-4aee-9f73-85b4b6959665\") " Jul 30 13:02:04.774793 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:02:04.774633 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2c4d0758-9486-4aee-9f73-85b4b6959665-service-ca\") pod \"2c4d0758-9486-4aee-9f73-85b4b6959665\" (UID: \"2c4d0758-9486-4aee-9f73-85b4b6959665\") " Jul 30 13:02:04.774793 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:02:04.774693 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2c4d0758-9486-4aee-9f73-85b4b6959665-oauth-serving-cert\") pod \"2c4d0758-9486-4aee-9f73-85b4b6959665\" (UID: \"2c4d0758-9486-4aee-9f73-85b4b6959665\") " Jul 30 13:02:04.775016 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:02:04.774972 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c4d0758-9486-4aee-9f73-85b4b6959665-console-config" (OuterVolumeSpecName: "console-config") pod "2c4d0758-9486-4aee-9f73-85b4b6959665" (UID: "2c4d0758-9486-4aee-9f73-85b4b6959665"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 13:02:04.775135 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:02:04.775063 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c4d0758-9486-4aee-9f73-85b4b6959665-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2c4d0758-9486-4aee-9f73-85b4b6959665" (UID: "2c4d0758-9486-4aee-9f73-85b4b6959665"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 13:02:04.775221 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:02:04.775125 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c4d0758-9486-4aee-9f73-85b4b6959665-service-ca" (OuterVolumeSpecName: "service-ca") pod "2c4d0758-9486-4aee-9f73-85b4b6959665" (UID: "2c4d0758-9486-4aee-9f73-85b4b6959665"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 13:02:04.777239 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:02:04.777177 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c4d0758-9486-4aee-9f73-85b4b6959665-kube-api-access-x7j5b" (OuterVolumeSpecName: "kube-api-access-x7j5b") pod "2c4d0758-9486-4aee-9f73-85b4b6959665" (UID: "2c4d0758-9486-4aee-9f73-85b4b6959665"). InnerVolumeSpecName "kube-api-access-x7j5b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 13:02:04.777239 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:02:04.777207 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c4d0758-9486-4aee-9f73-85b4b6959665-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2c4d0758-9486-4aee-9f73-85b4b6959665" (UID: "2c4d0758-9486-4aee-9f73-85b4b6959665"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 30 13:02:04.777239 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:02:04.777220 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c4d0758-9486-4aee-9f73-85b4b6959665-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2c4d0758-9486-4aee-9f73-85b4b6959665" (UID: "2c4d0758-9486-4aee-9f73-85b4b6959665"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 30 13:02:04.876108 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:02:04.876067 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x7j5b\" (UniqueName: \"kubernetes.io/projected/2c4d0758-9486-4aee-9f73-85b4b6959665-kube-api-access-x7j5b\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 13:02:04.876108 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:02:04.876099 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2c4d0758-9486-4aee-9f73-85b4b6959665-console-oauth-config\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 13:02:04.876108 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:02:04.876109 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2c4d0758-9486-4aee-9f73-85b4b6959665-console-config\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 13:02:04.876108 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:02:04.876119 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2c4d0758-9486-4aee-9f73-85b4b6959665-console-serving-cert\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 13:02:04.876438 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:02:04.876129 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2c4d0758-9486-4aee-9f73-85b4b6959665-service-ca\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 13:02:04.876438 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:02:04.876137 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2c4d0758-9486-4aee-9f73-85b4b6959665-oauth-serving-cert\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 13:02:05.525948 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:02:05.525909 2579 generic.go:356] "Generic (PLEG): container finished" podID="2c4d0758-9486-4aee-9f73-85b4b6959665" containerID="9d81101b9f1e5d3628449f1563bb35aeab0b14e5c9447d15322f8ab560d86899" exitCode=0 Jul 30 13:02:05.526407 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:02:05.525972 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6474f4b7f6-6q9bm" Jul 30 13:02:05.526407 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:02:05.525980 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6474f4b7f6-6q9bm" event={"ID":"2c4d0758-9486-4aee-9f73-85b4b6959665","Type":"ContainerDied","Data":"9d81101b9f1e5d3628449f1563bb35aeab0b14e5c9447d15322f8ab560d86899"} Jul 30 13:02:05.526407 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:02:05.526065 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6474f4b7f6-6q9bm" event={"ID":"2c4d0758-9486-4aee-9f73-85b4b6959665","Type":"ContainerDied","Data":"94cf6a4a2e48218da2fb0518c2d17b63b5f32bf688f949b6f7581b67fb8e9799"} Jul 30 13:02:05.526407 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:02:05.526103 2579 scope.go:117] "RemoveContainer" containerID="9d81101b9f1e5d3628449f1563bb35aeab0b14e5c9447d15322f8ab560d86899" Jul 30 13:02:05.535137 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:02:05.535120 2579 scope.go:117] "RemoveContainer" containerID="9d81101b9f1e5d3628449f1563bb35aeab0b14e5c9447d15322f8ab560d86899" Jul 30 13:02:05.535445 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:02:05.535409 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d81101b9f1e5d3628449f1563bb35aeab0b14e5c9447d15322f8ab560d86899\": container with ID starting with 9d81101b9f1e5d3628449f1563bb35aeab0b14e5c9447d15322f8ab560d86899 not found: ID does not exist" containerID="9d81101b9f1e5d3628449f1563bb35aeab0b14e5c9447d15322f8ab560d86899" Jul 30 13:02:05.535522 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:02:05.535460 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d81101b9f1e5d3628449f1563bb35aeab0b14e5c9447d15322f8ab560d86899"} err="failed to get container status \"9d81101b9f1e5d3628449f1563bb35aeab0b14e5c9447d15322f8ab560d86899\": rpc error: code = NotFound desc = could not find container \"9d81101b9f1e5d3628449f1563bb35aeab0b14e5c9447d15322f8ab560d86899\": container with ID starting with 9d81101b9f1e5d3628449f1563bb35aeab0b14e5c9447d15322f8ab560d86899 not found: ID does not exist" Jul 30 13:02:05.546993 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:02:05.546965 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6474f4b7f6-6q9bm"] Jul 30 13:02:05.551971 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:02:05.551949 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6474f4b7f6-6q9bm"] Jul 30 13:02:06.706970 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:02:06.706938 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c4d0758-9486-4aee-9f73-85b4b6959665" path="/var/lib/kubelet/pods/2c4d0758-9486-4aee-9f73-85b4b6959665/volumes" Jul 30 13:02:07.189204 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:02:07.189116 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:02:07.264197 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:02:07.264163 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:02:08.505954 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:02:08.505929 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-598js" Jul 30 13:02:17.628922 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:02:17.628885 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:02:17.686365 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:02:17.686328 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:02:20.611131 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:02:20.611064 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5f64975989-wg2rc" podUID="2fd91df7-cf89-4e0b-b993-1e4137e59ae3" containerName="console" containerID="cri-o://e7d88469ea59b67fcb23111e617f04bbe8852f10585c0d0bcd88c8f632cfc441" gracePeriod=15 Jul 30 13:02:20.856287 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:02:20.856257 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f64975989-wg2rc" Jul 30 13:02:20.902195 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:02:20.902114 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fd91df7-cf89-4e0b-b993-1e4137e59ae3-trusted-ca-bundle\") pod \"2fd91df7-cf89-4e0b-b993-1e4137e59ae3\" (UID: \"2fd91df7-cf89-4e0b-b993-1e4137e59ae3\") " Jul 30 13:02:20.902195 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:02:20.902153 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2fd91df7-cf89-4e0b-b993-1e4137e59ae3-console-serving-cert\") pod \"2fd91df7-cf89-4e0b-b993-1e4137e59ae3\" (UID: \"2fd91df7-cf89-4e0b-b993-1e4137e59ae3\") " Jul 30 13:02:20.902195 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:02:20.902173 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2fd91df7-cf89-4e0b-b993-1e4137e59ae3-console-oauth-config\") pod \"2fd91df7-cf89-4e0b-b993-1e4137e59ae3\" (UID: \"2fd91df7-cf89-4e0b-b993-1e4137e59ae3\") " Jul 30 13:02:20.902469 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:02:20.902225 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2fd91df7-cf89-4e0b-b993-1e4137e59ae3-oauth-serving-cert\") pod \"2fd91df7-cf89-4e0b-b993-1e4137e59ae3\" (UID: \"2fd91df7-cf89-4e0b-b993-1e4137e59ae3\") " Jul 30 13:02:20.902469 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:02:20.902240 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2fd91df7-cf89-4e0b-b993-1e4137e59ae3-console-config\") pod \"2fd91df7-cf89-4e0b-b993-1e4137e59ae3\" (UID: \"2fd91df7-cf89-4e0b-b993-1e4137e59ae3\") " Jul 30 13:02:20.902469 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:02:20.902353 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2fd91df7-cf89-4e0b-b993-1e4137e59ae3-service-ca\") pod \"2fd91df7-cf89-4e0b-b993-1e4137e59ae3\" (UID: \"2fd91df7-cf89-4e0b-b993-1e4137e59ae3\") " Jul 30 13:02:20.902469 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:02:20.902427 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p99xr\" (UniqueName: \"kubernetes.io/projected/2fd91df7-cf89-4e0b-b993-1e4137e59ae3-kube-api-access-p99xr\") pod \"2fd91df7-cf89-4e0b-b993-1e4137e59ae3\" (UID: \"2fd91df7-cf89-4e0b-b993-1e4137e59ae3\") " Jul 30 13:02:20.902657 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:02:20.902530 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fd91df7-cf89-4e0b-b993-1e4137e59ae3-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "2fd91df7-cf89-4e0b-b993-1e4137e59ae3" (UID: "2fd91df7-cf89-4e0b-b993-1e4137e59ae3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 13:02:20.902740 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:02:20.902721 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fd91df7-cf89-4e0b-b993-1e4137e59ae3-trusted-ca-bundle\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 13:02:20.902789 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:02:20.902721 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fd91df7-cf89-4e0b-b993-1e4137e59ae3-console-config" (OuterVolumeSpecName: "console-config") pod "2fd91df7-cf89-4e0b-b993-1e4137e59ae3" (UID: "2fd91df7-cf89-4e0b-b993-1e4137e59ae3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 13:02:20.902789 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:02:20.902735 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fd91df7-cf89-4e0b-b993-1e4137e59ae3-service-ca" (OuterVolumeSpecName: "service-ca") pod "2fd91df7-cf89-4e0b-b993-1e4137e59ae3" (UID: "2fd91df7-cf89-4e0b-b993-1e4137e59ae3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 13:02:20.902968 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:02:20.902938 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fd91df7-cf89-4e0b-b993-1e4137e59ae3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2fd91df7-cf89-4e0b-b993-1e4137e59ae3" (UID: "2fd91df7-cf89-4e0b-b993-1e4137e59ae3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 13:02:20.904333 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:02:20.904313 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fd91df7-cf89-4e0b-b993-1e4137e59ae3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2fd91df7-cf89-4e0b-b993-1e4137e59ae3" (UID: "2fd91df7-cf89-4e0b-b993-1e4137e59ae3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 30 13:02:20.904551 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:02:20.904528 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fd91df7-cf89-4e0b-b993-1e4137e59ae3-kube-api-access-p99xr" (OuterVolumeSpecName: "kube-api-access-p99xr") pod "2fd91df7-cf89-4e0b-b993-1e4137e59ae3" (UID: "2fd91df7-cf89-4e0b-b993-1e4137e59ae3"). InnerVolumeSpecName "kube-api-access-p99xr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 13:02:20.904604 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:02:20.904592 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fd91df7-cf89-4e0b-b993-1e4137e59ae3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2fd91df7-cf89-4e0b-b993-1e4137e59ae3" (UID: "2fd91df7-cf89-4e0b-b993-1e4137e59ae3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 30 13:02:21.003405 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:02:21.003373 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2fd91df7-cf89-4e0b-b993-1e4137e59ae3-service-ca\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 13:02:21.003405 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:02:21.003401 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p99xr\" (UniqueName: \"kubernetes.io/projected/2fd91df7-cf89-4e0b-b993-1e4137e59ae3-kube-api-access-p99xr\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 13:02:21.003648 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:02:21.003429 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2fd91df7-cf89-4e0b-b993-1e4137e59ae3-console-serving-cert\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 13:02:21.003648 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:02:21.003440 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2fd91df7-cf89-4e0b-b993-1e4137e59ae3-console-oauth-config\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 13:02:21.003648 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:02:21.003450 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2fd91df7-cf89-4e0b-b993-1e4137e59ae3-oauth-serving-cert\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 13:02:21.003648 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:02:21.003458 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2fd91df7-cf89-4e0b-b993-1e4137e59ae3-console-config\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 13:02:21.588089 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:02:21.588053 2579 generic.go:356] "Generic (PLEG): container finished" podID="2fd91df7-cf89-4e0b-b993-1e4137e59ae3" containerID="e7d88469ea59b67fcb23111e617f04bbe8852f10585c0d0bcd88c8f632cfc441" exitCode=0 Jul 30 13:02:21.588334 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:02:21.588099 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f64975989-wg2rc" Jul 30 13:02:21.588334 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:02:21.588134 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f64975989-wg2rc" event={"ID":"2fd91df7-cf89-4e0b-b993-1e4137e59ae3","Type":"ContainerDied","Data":"e7d88469ea59b67fcb23111e617f04bbe8852f10585c0d0bcd88c8f632cfc441"} Jul 30 13:02:21.588334 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:02:21.588173 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f64975989-wg2rc" event={"ID":"2fd91df7-cf89-4e0b-b993-1e4137e59ae3","Type":"ContainerDied","Data":"420eefa8d6ff224e681316a78ba9fa254b4219995c40298c110af4bd3c407ea2"} Jul 30 13:02:21.588334 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:02:21.588193 2579 scope.go:117] "RemoveContainer" containerID="e7d88469ea59b67fcb23111e617f04bbe8852f10585c0d0bcd88c8f632cfc441" Jul 30 13:02:21.596672 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:02:21.596653 2579 scope.go:117] "RemoveContainer" containerID="e7d88469ea59b67fcb23111e617f04bbe8852f10585c0d0bcd88c8f632cfc441" Jul 30 13:02:21.596939 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:02:21.596920 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7d88469ea59b67fcb23111e617f04bbe8852f10585c0d0bcd88c8f632cfc441\": container with ID starting with e7d88469ea59b67fcb23111e617f04bbe8852f10585c0d0bcd88c8f632cfc441 not found: ID does not exist" containerID="e7d88469ea59b67fcb23111e617f04bbe8852f10585c0d0bcd88c8f632cfc441" Jul 30 13:02:21.597007 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:02:21.596956 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7d88469ea59b67fcb23111e617f04bbe8852f10585c0d0bcd88c8f632cfc441"} err="failed to get container status \"e7d88469ea59b67fcb23111e617f04bbe8852f10585c0d0bcd88c8f632cfc441\": rpc error: code = NotFound desc = could not find container \"e7d88469ea59b67fcb23111e617f04bbe8852f10585c0d0bcd88c8f632cfc441\": container with ID starting with e7d88469ea59b67fcb23111e617f04bbe8852f10585c0d0bcd88c8f632cfc441 not found: ID does not exist" Jul 30 13:02:21.610326 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:02:21.610296 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f64975989-wg2rc"] Jul 30 13:02:21.614423 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:02:21.614388 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5f64975989-wg2rc"] Jul 30 13:02:22.705873 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:02:22.705830 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2fd91df7-cf89-4e0b-b993-1e4137e59ae3" path="/var/lib/kubelet/pods/2fd91df7-cf89-4e0b-b993-1e4137e59ae3/volumes" Jul 30 13:02:44.719517 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:02:44.719481 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:03:00.282264 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:00.282219 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:03:00.383343 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:00.383307 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:03:04.409185 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:04.409148 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-59f64b9746-b45g5"] Jul 30 13:03:04.409738 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:04.409715 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fd91df7-cf89-4e0b-b993-1e4137e59ae3" containerName="console" Jul 30 13:03:04.409814 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:04.409741 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fd91df7-cf89-4e0b-b993-1e4137e59ae3" containerName="console" Jul 30 13:03:04.409814 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:04.409762 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c4d0758-9486-4aee-9f73-85b4b6959665" containerName="console" Jul 30 13:03:04.409814 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:04.409772 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c4d0758-9486-4aee-9f73-85b4b6959665" containerName="console" Jul 30 13:03:04.409957 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:04.409859 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c4d0758-9486-4aee-9f73-85b4b6959665" containerName="console" Jul 30 13:03:04.409957 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:04.409871 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fd91df7-cf89-4e0b-b993-1e4137e59ae3" containerName="console" Jul 30 13:03:04.412962 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:04.412941 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-59f64b9746-b45g5" Jul 30 13:03:04.415973 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:04.415948 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 30 13:03:04.416179 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:04.416024 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 30 13:03:04.416285 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:04.416041 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 30 13:03:04.416455 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:04.416435 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-79b7j\"" Jul 30 13:03:04.416545 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:04.416464 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 30 13:03:04.416545 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:04.416489 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 30 13:03:04.421144 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:04.421105 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 30 13:03:04.426808 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:04.426785 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-59f64b9746-b45g5"] Jul 30 13:03:04.453215 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:04.453175 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ad964398-924e-4920-b1b2-d1020880cc2e-telemeter-client-tls\") pod \"telemeter-client-59f64b9746-b45g5\" (UID: \"ad964398-924e-4920-b1b2-d1020880cc2e\") " pod="openshift-monitoring/telemeter-client-59f64b9746-b45g5" Jul 30 13:03:04.453406 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:04.453223 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ad964398-924e-4920-b1b2-d1020880cc2e-federate-client-tls\") pod \"telemeter-client-59f64b9746-b45g5\" (UID: \"ad964398-924e-4920-b1b2-d1020880cc2e\") " pod="openshift-monitoring/telemeter-client-59f64b9746-b45g5" Jul 30 13:03:04.453406 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:04.453263 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad964398-924e-4920-b1b2-d1020880cc2e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-59f64b9746-b45g5\" (UID: \"ad964398-924e-4920-b1b2-d1020880cc2e\") " pod="openshift-monitoring/telemeter-client-59f64b9746-b45g5" Jul 30 13:03:04.453406 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:04.453288 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ad964398-924e-4920-b1b2-d1020880cc2e-metrics-client-ca\") pod \"telemeter-client-59f64b9746-b45g5\" (UID: \"ad964398-924e-4920-b1b2-d1020880cc2e\") " pod="openshift-monitoring/telemeter-client-59f64b9746-b45g5" Jul 30 13:03:04.453406 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:04.453333 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9llv\" (UniqueName: \"kubernetes.io/projected/ad964398-924e-4920-b1b2-d1020880cc2e-kube-api-access-x9llv\") pod \"telemeter-client-59f64b9746-b45g5\" (UID: \"ad964398-924e-4920-b1b2-d1020880cc2e\") " pod="openshift-monitoring/telemeter-client-59f64b9746-b45g5" Jul 30 13:03:04.453406 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:04.453374 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ad964398-924e-4920-b1b2-d1020880cc2e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-59f64b9746-b45g5\" (UID: \"ad964398-924e-4920-b1b2-d1020880cc2e\") " pod="openshift-monitoring/telemeter-client-59f64b9746-b45g5" Jul 30 13:03:04.453661 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:04.453427 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad964398-924e-4920-b1b2-d1020880cc2e-serving-certs-ca-bundle\") pod \"telemeter-client-59f64b9746-b45g5\" (UID: \"ad964398-924e-4920-b1b2-d1020880cc2e\") " pod="openshift-monitoring/telemeter-client-59f64b9746-b45g5" Jul 30 13:03:04.453661 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:04.453458 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ad964398-924e-4920-b1b2-d1020880cc2e-secret-telemeter-client\") pod \"telemeter-client-59f64b9746-b45g5\" (UID: \"ad964398-924e-4920-b1b2-d1020880cc2e\") " pod="openshift-monitoring/telemeter-client-59f64b9746-b45g5" Jul 30 13:03:04.554078 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:04.554036 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad964398-924e-4920-b1b2-d1020880cc2e-serving-certs-ca-bundle\") pod \"telemeter-client-59f64b9746-b45g5\" (UID: \"ad964398-924e-4920-b1b2-d1020880cc2e\") " pod="openshift-monitoring/telemeter-client-59f64b9746-b45g5" Jul 30 13:03:04.554078 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:04.554076 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ad964398-924e-4920-b1b2-d1020880cc2e-secret-telemeter-client\") pod \"telemeter-client-59f64b9746-b45g5\" (UID: \"ad964398-924e-4920-b1b2-d1020880cc2e\") " pod="openshift-monitoring/telemeter-client-59f64b9746-b45g5" Jul 30 13:03:04.554351 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:04.554101 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ad964398-924e-4920-b1b2-d1020880cc2e-telemeter-client-tls\") pod \"telemeter-client-59f64b9746-b45g5\" (UID: \"ad964398-924e-4920-b1b2-d1020880cc2e\") " pod="openshift-monitoring/telemeter-client-59f64b9746-b45g5" Jul 30 13:03:04.554351 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:04.554120 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ad964398-924e-4920-b1b2-d1020880cc2e-federate-client-tls\") pod \"telemeter-client-59f64b9746-b45g5\" (UID: \"ad964398-924e-4920-b1b2-d1020880cc2e\") " pod="openshift-monitoring/telemeter-client-59f64b9746-b45g5" Jul 30 13:03:04.554351 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:04.554150 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad964398-924e-4920-b1b2-d1020880cc2e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-59f64b9746-b45g5\" (UID: \"ad964398-924e-4920-b1b2-d1020880cc2e\") " pod="openshift-monitoring/telemeter-client-59f64b9746-b45g5" Jul 30 13:03:04.554351 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:04.554176 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ad964398-924e-4920-b1b2-d1020880cc2e-metrics-client-ca\") pod \"telemeter-client-59f64b9746-b45g5\" (UID: \"ad964398-924e-4920-b1b2-d1020880cc2e\") " pod="openshift-monitoring/telemeter-client-59f64b9746-b45g5" Jul 30 13:03:04.554351 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:04.554224 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9llv\" (UniqueName: \"kubernetes.io/projected/ad964398-924e-4920-b1b2-d1020880cc2e-kube-api-access-x9llv\") pod \"telemeter-client-59f64b9746-b45g5\" (UID: \"ad964398-924e-4920-b1b2-d1020880cc2e\") " pod="openshift-monitoring/telemeter-client-59f64b9746-b45g5" Jul 30 13:03:04.554351 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:04.554261 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ad964398-924e-4920-b1b2-d1020880cc2e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-59f64b9746-b45g5\" (UID: \"ad964398-924e-4920-b1b2-d1020880cc2e\") " pod="openshift-monitoring/telemeter-client-59f64b9746-b45g5" Jul 30 13:03:04.554859 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:04.554831 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad964398-924e-4920-b1b2-d1020880cc2e-serving-certs-ca-bundle\") pod \"telemeter-client-59f64b9746-b45g5\" (UID: \"ad964398-924e-4920-b1b2-d1020880cc2e\") " pod="openshift-monitoring/telemeter-client-59f64b9746-b45g5" Jul 30 13:03:04.555031 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:04.554982 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ad964398-924e-4920-b1b2-d1020880cc2e-metrics-client-ca\") pod \"telemeter-client-59f64b9746-b45g5\" (UID: \"ad964398-924e-4920-b1b2-d1020880cc2e\") " pod="openshift-monitoring/telemeter-client-59f64b9746-b45g5" Jul 30 13:03:04.555189 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:04.555169 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad964398-924e-4920-b1b2-d1020880cc2e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-59f64b9746-b45g5\" (UID: \"ad964398-924e-4920-b1b2-d1020880cc2e\") " pod="openshift-monitoring/telemeter-client-59f64b9746-b45g5" Jul 30 13:03:04.557186 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:04.557156 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ad964398-924e-4920-b1b2-d1020880cc2e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-59f64b9746-b45g5\" (UID: \"ad964398-924e-4920-b1b2-d1020880cc2e\") " pod="openshift-monitoring/telemeter-client-59f64b9746-b45g5" Jul 30 13:03:04.557362 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:04.557337 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ad964398-924e-4920-b1b2-d1020880cc2e-secret-telemeter-client\") pod \"telemeter-client-59f64b9746-b45g5\" (UID: \"ad964398-924e-4920-b1b2-d1020880cc2e\") " pod="openshift-monitoring/telemeter-client-59f64b9746-b45g5" Jul 30 13:03:04.557492 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:04.557473 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ad964398-924e-4920-b1b2-d1020880cc2e-telemeter-client-tls\") pod \"telemeter-client-59f64b9746-b45g5\" (UID: \"ad964398-924e-4920-b1b2-d1020880cc2e\") " pod="openshift-monitoring/telemeter-client-59f64b9746-b45g5" Jul 30 13:03:04.557593 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:04.557573 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ad964398-924e-4920-b1b2-d1020880cc2e-federate-client-tls\") pod \"telemeter-client-59f64b9746-b45g5\" (UID: \"ad964398-924e-4920-b1b2-d1020880cc2e\") " pod="openshift-monitoring/telemeter-client-59f64b9746-b45g5" Jul 30 13:03:04.562717 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:04.562697 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9llv\" (UniqueName: \"kubernetes.io/projected/ad964398-924e-4920-b1b2-d1020880cc2e-kube-api-access-x9llv\") pod \"telemeter-client-59f64b9746-b45g5\" (UID: \"ad964398-924e-4920-b1b2-d1020880cc2e\") " pod="openshift-monitoring/telemeter-client-59f64b9746-b45g5" Jul 30 13:03:04.724206 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:04.724176 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-59f64b9746-b45g5" Jul 30 13:03:04.856651 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:04.856619 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-59f64b9746-b45g5"] Jul 30 13:03:04.859324 ip-10-0-133-230 kubenswrapper[2579]: W0730 13:03:04.859285 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad964398_924e_4920_b1b2_d1020880cc2e.slice/crio-4f47e0b0ad81474495b9decbabb11045ff975c02a6f9f68b1b703e65816073c4 WatchSource:0}: Error finding container 4f47e0b0ad81474495b9decbabb11045ff975c02a6f9f68b1b703e65816073c4: Status 404 returned error can't find the container with id 4f47e0b0ad81474495b9decbabb11045ff975c02a6f9f68b1b703e65816073c4 Jul 30 13:03:05.758223 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:05.758190 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-59f64b9746-b45g5" event={"ID":"ad964398-924e-4920-b1b2-d1020880cc2e","Type":"ContainerStarted","Data":"4f47e0b0ad81474495b9decbabb11045ff975c02a6f9f68b1b703e65816073c4"} Jul 30 13:03:08.773192 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:08.773157 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-59f64b9746-b45g5" event={"ID":"ad964398-924e-4920-b1b2-d1020880cc2e","Type":"ContainerStarted","Data":"8e346025bfe1faa155b92e396016e2db7ef81c2190bfa3f727f353da570e34af"} Jul 30 13:03:08.773638 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:08.773210 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-59f64b9746-b45g5" event={"ID":"ad964398-924e-4920-b1b2-d1020880cc2e","Type":"ContainerStarted","Data":"1f5897cdd349b2981aa46010a5267eed41b5ba4c94c0954c51880aa20c9722c9"} Jul 30 13:03:08.773638 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:08.773233 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-59f64b9746-b45g5" event={"ID":"ad964398-924e-4920-b1b2-d1020880cc2e","Type":"ContainerStarted","Data":"3b1a69d671760ce39a3803cc21a1b6bb1a2e395af8d8f234efb12ec39137757d"} Jul 30 13:03:08.798431 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:08.798365 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-59f64b9746-b45g5" podStartSLOduration=1.5906349180000001 podStartE2EDuration="4.798347619s" totalImagesPullingTime="3.207712701s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:03:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:03:08.796197024 +0000 UTC m=+236.627663150" watchObservedRunningTime="2026-07-30 13:03:08.798347619 +0000 UTC m=+236.629813743" Jul 30 13:03:09.794156 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:09.794119 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8474c6b687-2hgpz"] Jul 30 13:03:09.797695 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:09.797666 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8474c6b687-2hgpz" Jul 30 13:03:09.808262 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:09.808203 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8474c6b687-2hgpz"] Jul 30 13:03:09.862744 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:09.862711 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:03:09.898951 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:09.898904 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11b635da-babe-4f6d-8e5e-738ee72f2429-console-config\") pod \"console-8474c6b687-2hgpz\" (UID: \"11b635da-babe-4f6d-8e5e-738ee72f2429\") " pod="openshift-console/console-8474c6b687-2hgpz" Jul 30 13:03:09.898951 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:09.898951 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11b635da-babe-4f6d-8e5e-738ee72f2429-oauth-serving-cert\") pod \"console-8474c6b687-2hgpz\" (UID: \"11b635da-babe-4f6d-8e5e-738ee72f2429\") " pod="openshift-console/console-8474c6b687-2hgpz" Jul 30 13:03:09.899170 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:09.899028 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11b635da-babe-4f6d-8e5e-738ee72f2429-console-serving-cert\") pod \"console-8474c6b687-2hgpz\" (UID: \"11b635da-babe-4f6d-8e5e-738ee72f2429\") " pod="openshift-console/console-8474c6b687-2hgpz" Jul 30 13:03:09.899170 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:09.899063 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11b635da-babe-4f6d-8e5e-738ee72f2429-console-oauth-config\") pod \"console-8474c6b687-2hgpz\" (UID: \"11b635da-babe-4f6d-8e5e-738ee72f2429\") " pod="openshift-console/console-8474c6b687-2hgpz" Jul 30 13:03:09.899170 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:09.899084 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11b635da-babe-4f6d-8e5e-738ee72f2429-trusted-ca-bundle\") pod \"console-8474c6b687-2hgpz\" (UID: \"11b635da-babe-4f6d-8e5e-738ee72f2429\") " pod="openshift-console/console-8474c6b687-2hgpz" Jul 30 13:03:09.899170 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:09.899111 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11b635da-babe-4f6d-8e5e-738ee72f2429-service-ca\") pod \"console-8474c6b687-2hgpz\" (UID: \"11b635da-babe-4f6d-8e5e-738ee72f2429\") " pod="openshift-console/console-8474c6b687-2hgpz" Jul 30 13:03:09.899170 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:09.899126 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkrbz\" (UniqueName: \"kubernetes.io/projected/11b635da-babe-4f6d-8e5e-738ee72f2429-kube-api-access-hkrbz\") pod \"console-8474c6b687-2hgpz\" (UID: \"11b635da-babe-4f6d-8e5e-738ee72f2429\") " pod="openshift-console/console-8474c6b687-2hgpz" Jul 30 13:03:09.999947 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:09.999919 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11b635da-babe-4f6d-8e5e-738ee72f2429-service-ca\") pod \"console-8474c6b687-2hgpz\" (UID: \"11b635da-babe-4f6d-8e5e-738ee72f2429\") " pod="openshift-console/console-8474c6b687-2hgpz" Jul 30 13:03:09.999947 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:09.999951 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkrbz\" (UniqueName: \"kubernetes.io/projected/11b635da-babe-4f6d-8e5e-738ee72f2429-kube-api-access-hkrbz\") pod \"console-8474c6b687-2hgpz\" (UID: \"11b635da-babe-4f6d-8e5e-738ee72f2429\") " pod="openshift-console/console-8474c6b687-2hgpz" Jul 30 13:03:10.000144 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:10.000070 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11b635da-babe-4f6d-8e5e-738ee72f2429-console-config\") pod \"console-8474c6b687-2hgpz\" (UID: \"11b635da-babe-4f6d-8e5e-738ee72f2429\") " pod="openshift-console/console-8474c6b687-2hgpz" Jul 30 13:03:10.000144 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:10.000103 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11b635da-babe-4f6d-8e5e-738ee72f2429-oauth-serving-cert\") pod \"console-8474c6b687-2hgpz\" (UID: \"11b635da-babe-4f6d-8e5e-738ee72f2429\") " pod="openshift-console/console-8474c6b687-2hgpz" Jul 30 13:03:10.000252 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:10.000172 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11b635da-babe-4f6d-8e5e-738ee72f2429-console-serving-cert\") pod \"console-8474c6b687-2hgpz\" (UID: \"11b635da-babe-4f6d-8e5e-738ee72f2429\") " pod="openshift-console/console-8474c6b687-2hgpz" Jul 30 13:03:10.000252 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:10.000200 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11b635da-babe-4f6d-8e5e-738ee72f2429-console-oauth-config\") pod \"console-8474c6b687-2hgpz\" (UID: \"11b635da-babe-4f6d-8e5e-738ee72f2429\") " pod="openshift-console/console-8474c6b687-2hgpz" Jul 30 13:03:10.000252 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:10.000226 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11b635da-babe-4f6d-8e5e-738ee72f2429-trusted-ca-bundle\") pod \"console-8474c6b687-2hgpz\" (UID: \"11b635da-babe-4f6d-8e5e-738ee72f2429\") " pod="openshift-console/console-8474c6b687-2hgpz" Jul 30 13:03:10.000817 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:10.000785 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11b635da-babe-4f6d-8e5e-738ee72f2429-console-config\") pod \"console-8474c6b687-2hgpz\" (UID: \"11b635da-babe-4f6d-8e5e-738ee72f2429\") " pod="openshift-console/console-8474c6b687-2hgpz" Jul 30 13:03:10.001006 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:10.000982 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11b635da-babe-4f6d-8e5e-738ee72f2429-oauth-serving-cert\") pod \"console-8474c6b687-2hgpz\" (UID: \"11b635da-babe-4f6d-8e5e-738ee72f2429\") " pod="openshift-console/console-8474c6b687-2hgpz" Jul 30 13:03:10.001082 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:10.001055 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11b635da-babe-4f6d-8e5e-738ee72f2429-trusted-ca-bundle\") pod \"console-8474c6b687-2hgpz\" (UID: \"11b635da-babe-4f6d-8e5e-738ee72f2429\") " pod="openshift-console/console-8474c6b687-2hgpz" Jul 30 13:03:10.001320 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:10.001303 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11b635da-babe-4f6d-8e5e-738ee72f2429-service-ca\") pod \"console-8474c6b687-2hgpz\" (UID: \"11b635da-babe-4f6d-8e5e-738ee72f2429\") " pod="openshift-console/console-8474c6b687-2hgpz" Jul 30 13:03:10.002583 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:10.002567 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11b635da-babe-4f6d-8e5e-738ee72f2429-console-oauth-config\") pod \"console-8474c6b687-2hgpz\" (UID: \"11b635da-babe-4f6d-8e5e-738ee72f2429\") " pod="openshift-console/console-8474c6b687-2hgpz" Jul 30 13:03:10.002791 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:10.002772 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11b635da-babe-4f6d-8e5e-738ee72f2429-console-serving-cert\") pod \"console-8474c6b687-2hgpz\" (UID: \"11b635da-babe-4f6d-8e5e-738ee72f2429\") " pod="openshift-console/console-8474c6b687-2hgpz" Jul 30 13:03:10.008296 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:10.008269 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkrbz\" (UniqueName: \"kubernetes.io/projected/11b635da-babe-4f6d-8e5e-738ee72f2429-kube-api-access-hkrbz\") pod \"console-8474c6b687-2hgpz\" (UID: \"11b635da-babe-4f6d-8e5e-738ee72f2429\") " pod="openshift-console/console-8474c6b687-2hgpz" Jul 30 13:03:10.110292 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:10.110197 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8474c6b687-2hgpz" Jul 30 13:03:10.246516 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:10.246491 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8474c6b687-2hgpz"] Jul 30 13:03:10.248888 ip-10-0-133-230 kubenswrapper[2579]: W0730 13:03:10.248857 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11b635da_babe_4f6d_8e5e_738ee72f2429.slice/crio-252204a8e506c2e40ecd87a1cfb7aaaf446f163c55c1387f83da5fc411cbbe7a WatchSource:0}: Error finding container 252204a8e506c2e40ecd87a1cfb7aaaf446f163c55c1387f83da5fc411cbbe7a: Status 404 returned error can't find the container with id 252204a8e506c2e40ecd87a1cfb7aaaf446f163c55c1387f83da5fc411cbbe7a Jul 30 13:03:10.782405 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:10.782366 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8474c6b687-2hgpz" event={"ID":"11b635da-babe-4f6d-8e5e-738ee72f2429","Type":"ContainerStarted","Data":"f8b31ab6cddfd7dc11e49774dd92a35c624076cd022aed67e757a20a58373cf5"} Jul 30 13:03:10.782627 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:10.782441 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8474c6b687-2hgpz" event={"ID":"11b635da-babe-4f6d-8e5e-738ee72f2429","Type":"ContainerStarted","Data":"252204a8e506c2e40ecd87a1cfb7aaaf446f163c55c1387f83da5fc411cbbe7a"} Jul 30 13:03:10.801792 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:10.801740 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8474c6b687-2hgpz" podStartSLOduration=1.801720346 podStartE2EDuration="1.801720346s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:03:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:03:10.801369945 +0000 UTC m=+238.632836070" watchObservedRunningTime="2026-07-30 13:03:10.801720346 +0000 UTC m=+238.633186471" Jul 30 13:03:14.600370 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:14.600332 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:03:14.654207 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:14.654178 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:03:17.627061 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:17.627030 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8474c6b687-2hgpz"] Jul 30 13:03:17.661221 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:17.661187 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-bb9bb88dd-l7j87"] Jul 30 13:03:17.665722 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:17.665701 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bb9bb88dd-l7j87" Jul 30 13:03:17.673861 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:17.673837 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bb9bb88dd-l7j87"] Jul 30 13:03:17.772926 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:17.772883 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7107c095-9a94-4531-9169-0b77f21cb204-console-config\") pod \"console-bb9bb88dd-l7j87\" (UID: \"7107c095-9a94-4531-9169-0b77f21cb204\") " pod="openshift-console/console-bb9bb88dd-l7j87" Jul 30 13:03:17.772926 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:17.772929 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7107c095-9a94-4531-9169-0b77f21cb204-service-ca\") pod \"console-bb9bb88dd-l7j87\" (UID: \"7107c095-9a94-4531-9169-0b77f21cb204\") " pod="openshift-console/console-bb9bb88dd-l7j87" Jul 30 13:03:17.773186 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:17.772945 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7107c095-9a94-4531-9169-0b77f21cb204-oauth-serving-cert\") pod \"console-bb9bb88dd-l7j87\" (UID: \"7107c095-9a94-4531-9169-0b77f21cb204\") " pod="openshift-console/console-bb9bb88dd-l7j87" Jul 30 13:03:17.773186 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:17.773040 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7107c095-9a94-4531-9169-0b77f21cb204-trusted-ca-bundle\") pod \"console-bb9bb88dd-l7j87\" (UID: \"7107c095-9a94-4531-9169-0b77f21cb204\") " pod="openshift-console/console-bb9bb88dd-l7j87" Jul 30 13:03:17.773186 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:17.773114 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7107c095-9a94-4531-9169-0b77f21cb204-console-serving-cert\") pod \"console-bb9bb88dd-l7j87\" (UID: \"7107c095-9a94-4531-9169-0b77f21cb204\") " pod="openshift-console/console-bb9bb88dd-l7j87" Jul 30 13:03:17.773186 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:17.773130 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7107c095-9a94-4531-9169-0b77f21cb204-console-oauth-config\") pod \"console-bb9bb88dd-l7j87\" (UID: \"7107c095-9a94-4531-9169-0b77f21cb204\") " pod="openshift-console/console-bb9bb88dd-l7j87" Jul 30 13:03:17.773186 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:17.773151 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5v274\" (UniqueName: \"kubernetes.io/projected/7107c095-9a94-4531-9169-0b77f21cb204-kube-api-access-5v274\") pod \"console-bb9bb88dd-l7j87\" (UID: \"7107c095-9a94-4531-9169-0b77f21cb204\") " pod="openshift-console/console-bb9bb88dd-l7j87" Jul 30 13:03:17.873941 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:17.873910 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7107c095-9a94-4531-9169-0b77f21cb204-console-serving-cert\") pod \"console-bb9bb88dd-l7j87\" (UID: \"7107c095-9a94-4531-9169-0b77f21cb204\") " pod="openshift-console/console-bb9bb88dd-l7j87" Jul 30 13:03:17.873941 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:17.873943 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7107c095-9a94-4531-9169-0b77f21cb204-console-oauth-config\") pod \"console-bb9bb88dd-l7j87\" (UID: \"7107c095-9a94-4531-9169-0b77f21cb204\") " pod="openshift-console/console-bb9bb88dd-l7j87" Jul 30 13:03:17.874161 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:17.873962 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5v274\" (UniqueName: \"kubernetes.io/projected/7107c095-9a94-4531-9169-0b77f21cb204-kube-api-access-5v274\") pod \"console-bb9bb88dd-l7j87\" (UID: \"7107c095-9a94-4531-9169-0b77f21cb204\") " pod="openshift-console/console-bb9bb88dd-l7j87" Jul 30 13:03:17.874161 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:17.874022 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7107c095-9a94-4531-9169-0b77f21cb204-console-config\") pod \"console-bb9bb88dd-l7j87\" (UID: \"7107c095-9a94-4531-9169-0b77f21cb204\") " pod="openshift-console/console-bb9bb88dd-l7j87" Jul 30 13:03:17.874161 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:17.874064 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7107c095-9a94-4531-9169-0b77f21cb204-service-ca\") pod \"console-bb9bb88dd-l7j87\" (UID: \"7107c095-9a94-4531-9169-0b77f21cb204\") " pod="openshift-console/console-bb9bb88dd-l7j87" Jul 30 13:03:17.874278 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:17.874176 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7107c095-9a94-4531-9169-0b77f21cb204-oauth-serving-cert\") pod \"console-bb9bb88dd-l7j87\" (UID: \"7107c095-9a94-4531-9169-0b77f21cb204\") " pod="openshift-console/console-bb9bb88dd-l7j87" Jul 30 13:03:17.874278 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:17.874258 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7107c095-9a94-4531-9169-0b77f21cb204-trusted-ca-bundle\") pod \"console-bb9bb88dd-l7j87\" (UID: \"7107c095-9a94-4531-9169-0b77f21cb204\") " pod="openshift-console/console-bb9bb88dd-l7j87" Jul 30 13:03:17.874971 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:17.874948 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7107c095-9a94-4531-9169-0b77f21cb204-service-ca\") pod \"console-bb9bb88dd-l7j87\" (UID: \"7107c095-9a94-4531-9169-0b77f21cb204\") " pod="openshift-console/console-bb9bb88dd-l7j87" Jul 30 13:03:17.874971 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:17.874966 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7107c095-9a94-4531-9169-0b77f21cb204-oauth-serving-cert\") pod \"console-bb9bb88dd-l7j87\" (UID: \"7107c095-9a94-4531-9169-0b77f21cb204\") " pod="openshift-console/console-bb9bb88dd-l7j87" Jul 30 13:03:17.875149 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:17.874972 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7107c095-9a94-4531-9169-0b77f21cb204-console-config\") pod \"console-bb9bb88dd-l7j87\" (UID: \"7107c095-9a94-4531-9169-0b77f21cb204\") " pod="openshift-console/console-bb9bb88dd-l7j87" Jul 30 13:03:17.875208 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:17.875145 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7107c095-9a94-4531-9169-0b77f21cb204-trusted-ca-bundle\") pod \"console-bb9bb88dd-l7j87\" (UID: \"7107c095-9a94-4531-9169-0b77f21cb204\") " pod="openshift-console/console-bb9bb88dd-l7j87" Jul 30 13:03:17.876430 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:17.876403 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7107c095-9a94-4531-9169-0b77f21cb204-console-oauth-config\") pod \"console-bb9bb88dd-l7j87\" (UID: \"7107c095-9a94-4531-9169-0b77f21cb204\") " pod="openshift-console/console-bb9bb88dd-l7j87" Jul 30 13:03:17.876741 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:17.876724 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7107c095-9a94-4531-9169-0b77f21cb204-console-serving-cert\") pod \"console-bb9bb88dd-l7j87\" (UID: \"7107c095-9a94-4531-9169-0b77f21cb204\") " pod="openshift-console/console-bb9bb88dd-l7j87" Jul 30 13:03:17.881791 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:17.881744 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5v274\" (UniqueName: \"kubernetes.io/projected/7107c095-9a94-4531-9169-0b77f21cb204-kube-api-access-5v274\") pod \"console-bb9bb88dd-l7j87\" (UID: \"7107c095-9a94-4531-9169-0b77f21cb204\") " pod="openshift-console/console-bb9bb88dd-l7j87" Jul 30 13:03:17.975485 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:17.975448 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bb9bb88dd-l7j87" Jul 30 13:03:18.111134 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:18.111108 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bb9bb88dd-l7j87"] Jul 30 13:03:18.113756 ip-10-0-133-230 kubenswrapper[2579]: W0730 13:03:18.113722 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7107c095_9a94_4531_9169_0b77f21cb204.slice/crio-8e17ab5b6cd6368f39e2ebadae94bf09757d5ada808f7a663cb4bb00b1adf9e0 WatchSource:0}: Error finding container 8e17ab5b6cd6368f39e2ebadae94bf09757d5ada808f7a663cb4bb00b1adf9e0: Status 404 returned error can't find the container with id 8e17ab5b6cd6368f39e2ebadae94bf09757d5ada808f7a663cb4bb00b1adf9e0 Jul 30 13:03:18.814059 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:18.814020 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bb9bb88dd-l7j87" event={"ID":"7107c095-9a94-4531-9169-0b77f21cb204","Type":"ContainerStarted","Data":"f5de8b41bb276e3a97f1036240b7e6d445d168498d3814f8cc5fdb7afbf3958c"} Jul 30 13:03:18.814498 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:18.814083 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bb9bb88dd-l7j87" event={"ID":"7107c095-9a94-4531-9169-0b77f21cb204","Type":"ContainerStarted","Data":"8e17ab5b6cd6368f39e2ebadae94bf09757d5ada808f7a663cb4bb00b1adf9e0"} Jul 30 13:03:18.834680 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:18.834624 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-bb9bb88dd-l7j87" podStartSLOduration=1.834608289 podStartE2EDuration="1.834608289s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:03:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:03:18.833832087 +0000 UTC m=+246.665298212" watchObservedRunningTime="2026-07-30 13:03:18.834608289 +0000 UTC m=+246.666074414" Jul 30 13:03:20.111327 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:20.111286 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8474c6b687-2hgpz" Jul 30 13:03:26.595470 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:26.595406 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:03:26.744043 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:26.744009 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:03:27.975809 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:27.975775 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-bb9bb88dd-l7j87" Jul 30 13:03:27.976194 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:27.975826 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-bb9bb88dd-l7j87" Jul 30 13:03:27.980394 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:27.980374 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-bb9bb88dd-l7j87" Jul 30 13:03:28.857999 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:28.857969 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-bb9bb88dd-l7j87" Jul 30 13:03:28.907883 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:28.907851 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6946f8bb4c-6m6xl"] Jul 30 13:03:29.036777 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:29.036736 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:03:29.136880 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:29.136801 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:03:29.200258 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:29.200228 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:03:37.196854 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:37.196769 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:03:37.296928 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:37.296893 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:03:42.645815 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:42.645771 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-8474c6b687-2hgpz" podUID="11b635da-babe-4f6d-8e5e-738ee72f2429" containerName="console" containerID="cri-o://f8b31ab6cddfd7dc11e49774dd92a35c624076cd022aed67e757a20a58373cf5" gracePeriod=15 Jul 30 13:03:42.895495 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:42.894062 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8474c6b687-2hgpz" Jul 30 13:03:42.908369 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:42.908284 2579 generic.go:356] "Generic (PLEG): container finished" podID="11b635da-babe-4f6d-8e5e-738ee72f2429" containerID="f8b31ab6cddfd7dc11e49774dd92a35c624076cd022aed67e757a20a58373cf5" exitCode=0 Jul 30 13:03:42.908369 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:42.908327 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8474c6b687-2hgpz" Jul 30 13:03:42.908554 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:42.908364 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8474c6b687-2hgpz" event={"ID":"11b635da-babe-4f6d-8e5e-738ee72f2429","Type":"ContainerDied","Data":"f8b31ab6cddfd7dc11e49774dd92a35c624076cd022aed67e757a20a58373cf5"} Jul 30 13:03:42.908554 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:42.908460 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8474c6b687-2hgpz" event={"ID":"11b635da-babe-4f6d-8e5e-738ee72f2429","Type":"ContainerDied","Data":"252204a8e506c2e40ecd87a1cfb7aaaf446f163c55c1387f83da5fc411cbbe7a"} Jul 30 13:03:42.908554 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:42.908481 2579 scope.go:117] "RemoveContainer" containerID="f8b31ab6cddfd7dc11e49774dd92a35c624076cd022aed67e757a20a58373cf5" Jul 30 13:03:42.918614 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:42.918587 2579 scope.go:117] "RemoveContainer" containerID="f8b31ab6cddfd7dc11e49774dd92a35c624076cd022aed67e757a20a58373cf5" Jul 30 13:03:42.918953 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:03:42.918931 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8b31ab6cddfd7dc11e49774dd92a35c624076cd022aed67e757a20a58373cf5\": container with ID starting with f8b31ab6cddfd7dc11e49774dd92a35c624076cd022aed67e757a20a58373cf5 not found: ID does not exist" containerID="f8b31ab6cddfd7dc11e49774dd92a35c624076cd022aed67e757a20a58373cf5" Jul 30 13:03:42.919021 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:42.918968 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8b31ab6cddfd7dc11e49774dd92a35c624076cd022aed67e757a20a58373cf5"} err="failed to get container status \"f8b31ab6cddfd7dc11e49774dd92a35c624076cd022aed67e757a20a58373cf5\": rpc error: code = NotFound desc = could not find container \"f8b31ab6cddfd7dc11e49774dd92a35c624076cd022aed67e757a20a58373cf5\": container with ID starting with f8b31ab6cddfd7dc11e49774dd92a35c624076cd022aed67e757a20a58373cf5 not found: ID does not exist" Jul 30 13:03:42.995373 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:42.995346 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11b635da-babe-4f6d-8e5e-738ee72f2429-console-config\") pod \"11b635da-babe-4f6d-8e5e-738ee72f2429\" (UID: \"11b635da-babe-4f6d-8e5e-738ee72f2429\") " Jul 30 13:03:42.995538 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:42.995491 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11b635da-babe-4f6d-8e5e-738ee72f2429-console-oauth-config\") pod \"11b635da-babe-4f6d-8e5e-738ee72f2429\" (UID: \"11b635da-babe-4f6d-8e5e-738ee72f2429\") " Jul 30 13:03:42.995538 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:42.995524 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11b635da-babe-4f6d-8e5e-738ee72f2429-oauth-serving-cert\") pod \"11b635da-babe-4f6d-8e5e-738ee72f2429\" (UID: \"11b635da-babe-4f6d-8e5e-738ee72f2429\") " Jul 30 13:03:42.995628 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:42.995557 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11b635da-babe-4f6d-8e5e-738ee72f2429-console-serving-cert\") pod \"11b635da-babe-4f6d-8e5e-738ee72f2429\" (UID: \"11b635da-babe-4f6d-8e5e-738ee72f2429\") " Jul 30 13:03:42.995628 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:42.995589 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11b635da-babe-4f6d-8e5e-738ee72f2429-service-ca\") pod \"11b635da-babe-4f6d-8e5e-738ee72f2429\" (UID: \"11b635da-babe-4f6d-8e5e-738ee72f2429\") " Jul 30 13:03:42.995723 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:42.995633 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11b635da-babe-4f6d-8e5e-738ee72f2429-trusted-ca-bundle\") pod \"11b635da-babe-4f6d-8e5e-738ee72f2429\" (UID: \"11b635da-babe-4f6d-8e5e-738ee72f2429\") " Jul 30 13:03:42.995723 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:42.995669 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hkrbz\" (UniqueName: \"kubernetes.io/projected/11b635da-babe-4f6d-8e5e-738ee72f2429-kube-api-access-hkrbz\") pod \"11b635da-babe-4f6d-8e5e-738ee72f2429\" (UID: \"11b635da-babe-4f6d-8e5e-738ee72f2429\") " Jul 30 13:03:42.995825 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:42.995765 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11b635da-babe-4f6d-8e5e-738ee72f2429-console-config" (OuterVolumeSpecName: "console-config") pod "11b635da-babe-4f6d-8e5e-738ee72f2429" (UID: "11b635da-babe-4f6d-8e5e-738ee72f2429"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 13:03:42.996048 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:42.996026 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11b635da-babe-4f6d-8e5e-738ee72f2429-console-config\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 13:03:42.996213 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:42.996063 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11b635da-babe-4f6d-8e5e-738ee72f2429-service-ca" (OuterVolumeSpecName: "service-ca") pod "11b635da-babe-4f6d-8e5e-738ee72f2429" (UID: "11b635da-babe-4f6d-8e5e-738ee72f2429"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 13:03:42.996316 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:42.996278 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11b635da-babe-4f6d-8e5e-738ee72f2429-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "11b635da-babe-4f6d-8e5e-738ee72f2429" (UID: "11b635da-babe-4f6d-8e5e-738ee72f2429"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 13:03:42.996452 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:42.996402 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11b635da-babe-4f6d-8e5e-738ee72f2429-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "11b635da-babe-4f6d-8e5e-738ee72f2429" (UID: "11b635da-babe-4f6d-8e5e-738ee72f2429"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 13:03:42.997668 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:42.997635 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11b635da-babe-4f6d-8e5e-738ee72f2429-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "11b635da-babe-4f6d-8e5e-738ee72f2429" (UID: "11b635da-babe-4f6d-8e5e-738ee72f2429"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 30 13:03:42.997843 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:42.997816 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11b635da-babe-4f6d-8e5e-738ee72f2429-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "11b635da-babe-4f6d-8e5e-738ee72f2429" (UID: "11b635da-babe-4f6d-8e5e-738ee72f2429"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 30 13:03:42.997924 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:42.997908 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11b635da-babe-4f6d-8e5e-738ee72f2429-kube-api-access-hkrbz" (OuterVolumeSpecName: "kube-api-access-hkrbz") pod "11b635da-babe-4f6d-8e5e-738ee72f2429" (UID: "11b635da-babe-4f6d-8e5e-738ee72f2429"). InnerVolumeSpecName "kube-api-access-hkrbz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 13:03:43.097318 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:43.097266 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11b635da-babe-4f6d-8e5e-738ee72f2429-console-oauth-config\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 13:03:43.097318 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:43.097313 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11b635da-babe-4f6d-8e5e-738ee72f2429-oauth-serving-cert\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 13:03:43.097318 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:43.097323 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11b635da-babe-4f6d-8e5e-738ee72f2429-console-serving-cert\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 13:03:43.097318 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:43.097332 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11b635da-babe-4f6d-8e5e-738ee72f2429-service-ca\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 13:03:43.097318 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:43.097341 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11b635da-babe-4f6d-8e5e-738ee72f2429-trusted-ca-bundle\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 13:03:43.097655 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:43.097350 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hkrbz\" (UniqueName: \"kubernetes.io/projected/11b635da-babe-4f6d-8e5e-738ee72f2429-kube-api-access-hkrbz\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 13:03:43.232808 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:43.232767 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8474c6b687-2hgpz"] Jul 30 13:03:43.238065 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:43.238037 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8474c6b687-2hgpz"] Jul 30 13:03:44.706875 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:44.706837 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11b635da-babe-4f6d-8e5e-738ee72f2429" path="/var/lib/kubelet/pods/11b635da-babe-4f6d-8e5e-738ee72f2429/volumes" Jul 30 13:03:45.473947 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:45.473910 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:03:45.572549 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:45.572511 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:03:53.929341 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:53.929297 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6946f8bb4c-6m6xl" podUID="e1afa3d9-e3f9-4687-b654-68c58daa1979" containerName="console" containerID="cri-o://bb07e09737a4818f852d7e9af5994d5ce5cfe04c60ce2d0639d1af56425b1757" gracePeriod=15 Jul 30 13:03:54.182798 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:54.182718 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6946f8bb4c-6m6xl" Jul 30 13:03:54.291546 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:54.291512 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e1afa3d9-e3f9-4687-b654-68c58daa1979-service-ca\") pod \"e1afa3d9-e3f9-4687-b654-68c58daa1979\" (UID: \"e1afa3d9-e3f9-4687-b654-68c58daa1979\") " Jul 30 13:03:54.291717 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:54.291567 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k7jd4\" (UniqueName: \"kubernetes.io/projected/e1afa3d9-e3f9-4687-b654-68c58daa1979-kube-api-access-k7jd4\") pod \"e1afa3d9-e3f9-4687-b654-68c58daa1979\" (UID: \"e1afa3d9-e3f9-4687-b654-68c58daa1979\") " Jul 30 13:03:54.291717 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:54.291599 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e1afa3d9-e3f9-4687-b654-68c58daa1979-trusted-ca-bundle\") pod \"e1afa3d9-e3f9-4687-b654-68c58daa1979\" (UID: \"e1afa3d9-e3f9-4687-b654-68c58daa1979\") " Jul 30 13:03:54.291717 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:54.291631 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e1afa3d9-e3f9-4687-b654-68c58daa1979-oauth-serving-cert\") pod \"e1afa3d9-e3f9-4687-b654-68c58daa1979\" (UID: \"e1afa3d9-e3f9-4687-b654-68c58daa1979\") " Jul 30 13:03:54.291717 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:54.291707 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e1afa3d9-e3f9-4687-b654-68c58daa1979-console-config\") pod \"e1afa3d9-e3f9-4687-b654-68c58daa1979\" (UID: \"e1afa3d9-e3f9-4687-b654-68c58daa1979\") " Jul 30 13:03:54.291943 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:54.291748 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e1afa3d9-e3f9-4687-b654-68c58daa1979-console-oauth-config\") pod \"e1afa3d9-e3f9-4687-b654-68c58daa1979\" (UID: \"e1afa3d9-e3f9-4687-b654-68c58daa1979\") " Jul 30 13:03:54.291943 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:54.291776 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e1afa3d9-e3f9-4687-b654-68c58daa1979-console-serving-cert\") pod \"e1afa3d9-e3f9-4687-b654-68c58daa1979\" (UID: \"e1afa3d9-e3f9-4687-b654-68c58daa1979\") " Jul 30 13:03:54.292065 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:54.292034 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e1afa3d9-e3f9-4687-b654-68c58daa1979-service-ca" (OuterVolumeSpecName: "service-ca") pod "e1afa3d9-e3f9-4687-b654-68c58daa1979" (UID: "e1afa3d9-e3f9-4687-b654-68c58daa1979"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 13:03:54.292065 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:54.292044 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e1afa3d9-e3f9-4687-b654-68c58daa1979-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e1afa3d9-e3f9-4687-b654-68c58daa1979" (UID: "e1afa3d9-e3f9-4687-b654-68c58daa1979"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 13:03:54.292218 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:54.292160 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e1afa3d9-e3f9-4687-b654-68c58daa1979-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e1afa3d9-e3f9-4687-b654-68c58daa1979" (UID: "e1afa3d9-e3f9-4687-b654-68c58daa1979"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 13:03:54.292345 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:54.292320 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e1afa3d9-e3f9-4687-b654-68c58daa1979-console-config" (OuterVolumeSpecName: "console-config") pod "e1afa3d9-e3f9-4687-b654-68c58daa1979" (UID: "e1afa3d9-e3f9-4687-b654-68c58daa1979"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 13:03:54.293799 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:54.293777 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1afa3d9-e3f9-4687-b654-68c58daa1979-kube-api-access-k7jd4" (OuterVolumeSpecName: "kube-api-access-k7jd4") pod "e1afa3d9-e3f9-4687-b654-68c58daa1979" (UID: "e1afa3d9-e3f9-4687-b654-68c58daa1979"). InnerVolumeSpecName "kube-api-access-k7jd4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 13:03:54.293964 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:54.293944 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e1afa3d9-e3f9-4687-b654-68c58daa1979-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e1afa3d9-e3f9-4687-b654-68c58daa1979" (UID: "e1afa3d9-e3f9-4687-b654-68c58daa1979"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 30 13:03:54.293964 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:54.293954 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e1afa3d9-e3f9-4687-b654-68c58daa1979-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e1afa3d9-e3f9-4687-b654-68c58daa1979" (UID: "e1afa3d9-e3f9-4687-b654-68c58daa1979"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 30 13:03:54.393138 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:54.393102 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k7jd4\" (UniqueName: \"kubernetes.io/projected/e1afa3d9-e3f9-4687-b654-68c58daa1979-kube-api-access-k7jd4\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 13:03:54.393138 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:54.393132 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e1afa3d9-e3f9-4687-b654-68c58daa1979-trusted-ca-bundle\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 13:03:54.393138 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:54.393141 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e1afa3d9-e3f9-4687-b654-68c58daa1979-oauth-serving-cert\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 13:03:54.393354 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:54.393151 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e1afa3d9-e3f9-4687-b654-68c58daa1979-console-config\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 13:03:54.393354 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:54.393160 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e1afa3d9-e3f9-4687-b654-68c58daa1979-console-oauth-config\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 13:03:54.393354 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:54.393169 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e1afa3d9-e3f9-4687-b654-68c58daa1979-console-serving-cert\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 13:03:54.393354 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:54.393177 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e1afa3d9-e3f9-4687-b654-68c58daa1979-service-ca\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 13:03:54.957030 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:54.956996 2579 generic.go:356] "Generic (PLEG): container finished" podID="e1afa3d9-e3f9-4687-b654-68c58daa1979" containerID="bb07e09737a4818f852d7e9af5994d5ce5cfe04c60ce2d0639d1af56425b1757" exitCode=0 Jul 30 13:03:54.957482 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:54.957036 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6946f8bb4c-6m6xl" Jul 30 13:03:54.957482 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:54.957082 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6946f8bb4c-6m6xl" event={"ID":"e1afa3d9-e3f9-4687-b654-68c58daa1979","Type":"ContainerDied","Data":"bb07e09737a4818f852d7e9af5994d5ce5cfe04c60ce2d0639d1af56425b1757"} Jul 30 13:03:54.957482 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:54.957130 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6946f8bb4c-6m6xl" event={"ID":"e1afa3d9-e3f9-4687-b654-68c58daa1979","Type":"ContainerDied","Data":"79fcc1afbb615a2ee6375b54b2d7ad24bf5135862726e70b47f4764f056e615b"} Jul 30 13:03:54.957482 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:54.957150 2579 scope.go:117] "RemoveContainer" containerID="bb07e09737a4818f852d7e9af5994d5ce5cfe04c60ce2d0639d1af56425b1757" Jul 30 13:03:54.965347 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:54.965299 2579 scope.go:117] "RemoveContainer" containerID="bb07e09737a4818f852d7e9af5994d5ce5cfe04c60ce2d0639d1af56425b1757" Jul 30 13:03:54.965617 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:03:54.965594 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb07e09737a4818f852d7e9af5994d5ce5cfe04c60ce2d0639d1af56425b1757\": container with ID starting with bb07e09737a4818f852d7e9af5994d5ce5cfe04c60ce2d0639d1af56425b1757 not found: ID does not exist" containerID="bb07e09737a4818f852d7e9af5994d5ce5cfe04c60ce2d0639d1af56425b1757" Jul 30 13:03:54.965705 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:54.965627 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb07e09737a4818f852d7e9af5994d5ce5cfe04c60ce2d0639d1af56425b1757"} err="failed to get container status \"bb07e09737a4818f852d7e9af5994d5ce5cfe04c60ce2d0639d1af56425b1757\": rpc error: code = NotFound desc = could not find container \"bb07e09737a4818f852d7e9af5994d5ce5cfe04c60ce2d0639d1af56425b1757\": container with ID starting with bb07e09737a4818f852d7e9af5994d5ce5cfe04c60ce2d0639d1af56425b1757 not found: ID does not exist" Jul 30 13:03:54.975725 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:54.975705 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6946f8bb4c-6m6xl"] Jul 30 13:03:54.979913 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:54.979889 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6946f8bb4c-6m6xl"] Jul 30 13:03:56.706652 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:56.706613 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1afa3d9-e3f9-4687-b654-68c58daa1979" path="/var/lib/kubelet/pods/e1afa3d9-e3f9-4687-b654-68c58daa1979/volumes" Jul 30 13:03:57.218218 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:57.218182 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:03:57.321560 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:57.321524 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:03:58.296492 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:58.296457 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lchkt"] Jul 30 13:03:58.296862 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:58.296750 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1afa3d9-e3f9-4687-b654-68c58daa1979" containerName="console" Jul 30 13:03:58.296862 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:58.296763 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1afa3d9-e3f9-4687-b654-68c58daa1979" containerName="console" Jul 30 13:03:58.296862 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:58.296780 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11b635da-babe-4f6d-8e5e-738ee72f2429" containerName="console" Jul 30 13:03:58.296862 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:58.296786 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="11b635da-babe-4f6d-8e5e-738ee72f2429" containerName="console" Jul 30 13:03:58.296862 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:58.296839 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1afa3d9-e3f9-4687-b654-68c58daa1979" containerName="console" Jul 30 13:03:58.296862 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:58.296850 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="11b635da-babe-4f6d-8e5e-738ee72f2429" containerName="console" Jul 30 13:03:58.301383 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:58.301365 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lchkt" Jul 30 13:03:58.304121 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:58.304084 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 30 13:03:58.304245 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:58.304171 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 30 13:03:58.305312 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:58.305297 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-kwchh\"" Jul 30 13:03:58.310132 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:58.310108 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lchkt"] Jul 30 13:03:58.429369 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:58.429331 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bef66d95-2f0c-4cf1-9f97-296f4ba9c85f-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lchkt\" (UID: \"bef66d95-2f0c-4cf1-9f97-296f4ba9c85f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lchkt" Jul 30 13:03:58.429583 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:58.429371 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjm5n\" (UniqueName: \"kubernetes.io/projected/bef66d95-2f0c-4cf1-9f97-296f4ba9c85f-kube-api-access-kjm5n\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lchkt\" (UID: \"bef66d95-2f0c-4cf1-9f97-296f4ba9c85f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lchkt" Jul 30 13:03:58.429583 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:58.429400 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bef66d95-2f0c-4cf1-9f97-296f4ba9c85f-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lchkt\" (UID: \"bef66d95-2f0c-4cf1-9f97-296f4ba9c85f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lchkt" Jul 30 13:03:58.530822 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:58.530778 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bef66d95-2f0c-4cf1-9f97-296f4ba9c85f-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lchkt\" (UID: \"bef66d95-2f0c-4cf1-9f97-296f4ba9c85f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lchkt" Jul 30 13:03:58.530822 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:58.530825 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjm5n\" (UniqueName: \"kubernetes.io/projected/bef66d95-2f0c-4cf1-9f97-296f4ba9c85f-kube-api-access-kjm5n\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lchkt\" (UID: \"bef66d95-2f0c-4cf1-9f97-296f4ba9c85f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lchkt" Jul 30 13:03:58.531044 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:58.530853 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bef66d95-2f0c-4cf1-9f97-296f4ba9c85f-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lchkt\" (UID: \"bef66d95-2f0c-4cf1-9f97-296f4ba9c85f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lchkt" Jul 30 13:03:58.531256 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:58.531234 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bef66d95-2f0c-4cf1-9f97-296f4ba9c85f-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lchkt\" (UID: \"bef66d95-2f0c-4cf1-9f97-296f4ba9c85f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lchkt" Jul 30 13:03:58.531330 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:58.531251 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bef66d95-2f0c-4cf1-9f97-296f4ba9c85f-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lchkt\" (UID: \"bef66d95-2f0c-4cf1-9f97-296f4ba9c85f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lchkt" Jul 30 13:03:58.540288 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:58.540265 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjm5n\" (UniqueName: \"kubernetes.io/projected/bef66d95-2f0c-4cf1-9f97-296f4ba9c85f-kube-api-access-kjm5n\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lchkt\" (UID: \"bef66d95-2f0c-4cf1-9f97-296f4ba9c85f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lchkt" Jul 30 13:03:58.611442 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:58.611324 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lchkt" Jul 30 13:03:58.764345 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:58.764297 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lchkt"] Jul 30 13:03:58.766792 ip-10-0-133-230 kubenswrapper[2579]: W0730 13:03:58.766765 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbef66d95_2f0c_4cf1_9f97_296f4ba9c85f.slice/crio-5e5c942942c5fa3e4543d5a2f4a197db24f600e380ec8c4db9f3ad717cb263b6 WatchSource:0}: Error finding container 5e5c942942c5fa3e4543d5a2f4a197db24f600e380ec8c4db9f3ad717cb263b6: Status 404 returned error can't find the container with id 5e5c942942c5fa3e4543d5a2f4a197db24f600e380ec8c4db9f3ad717cb263b6 Jul 30 13:03:58.974459 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:03:58.974395 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lchkt" event={"ID":"bef66d95-2f0c-4cf1-9f97-296f4ba9c85f","Type":"ContainerStarted","Data":"5e5c942942c5fa3e4543d5a2f4a197db24f600e380ec8c4db9f3ad717cb263b6"} Jul 30 13:04:07.007468 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:07.007432 2579 generic.go:356] "Generic (PLEG): container finished" podID="bef66d95-2f0c-4cf1-9f97-296f4ba9c85f" containerID="bb19f26b521d28de44cc739d9a38e841791c864933a0858dc0b0eb1123beb9c6" exitCode=0 Jul 30 13:04:07.007960 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:07.007504 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lchkt" event={"ID":"bef66d95-2f0c-4cf1-9f97-296f4ba9c85f","Type":"ContainerDied","Data":"bb19f26b521d28de44cc739d9a38e841791c864933a0858dc0b0eb1123beb9c6"} Jul 30 13:04:10.022366 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:10.022324 2579 generic.go:356] "Generic (PLEG): container finished" podID="bef66d95-2f0c-4cf1-9f97-296f4ba9c85f" containerID="7451e065559998e8e9149139c02574abe39feaa3999b526b220e3ccc8e819dde" exitCode=0 Jul 30 13:04:10.022851 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:10.022405 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lchkt" event={"ID":"bef66d95-2f0c-4cf1-9f97-296f4ba9c85f","Type":"ContainerDied","Data":"7451e065559998e8e9149139c02574abe39feaa3999b526b220e3ccc8e819dde"} Jul 30 13:04:12.595996 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:12.595964 2579 kubelet.go:1648] "Image garbage collection succeeded" Jul 30 13:04:13.820106 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:13.820068 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:04:17.054454 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:17.054393 2579 generic.go:356] "Generic (PLEG): container finished" podID="bef66d95-2f0c-4cf1-9f97-296f4ba9c85f" containerID="6d46ede832d4519896875be2ed2ecd7a627c0b85984c281657bc2facfe549cb8" exitCode=0 Jul 30 13:04:17.054881 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:17.054485 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lchkt" event={"ID":"bef66d95-2f0c-4cf1-9f97-296f4ba9c85f","Type":"ContainerDied","Data":"6d46ede832d4519896875be2ed2ecd7a627c0b85984c281657bc2facfe549cb8"} Jul 30 13:04:18.188637 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:18.188606 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lchkt" Jul 30 13:04:18.304380 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:18.304340 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bef66d95-2f0c-4cf1-9f97-296f4ba9c85f-util\") pod \"bef66d95-2f0c-4cf1-9f97-296f4ba9c85f\" (UID: \"bef66d95-2f0c-4cf1-9f97-296f4ba9c85f\") " Jul 30 13:04:18.304611 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:18.304493 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bef66d95-2f0c-4cf1-9f97-296f4ba9c85f-bundle\") pod \"bef66d95-2f0c-4cf1-9f97-296f4ba9c85f\" (UID: \"bef66d95-2f0c-4cf1-9f97-296f4ba9c85f\") " Jul 30 13:04:18.304611 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:18.304564 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kjm5n\" (UniqueName: \"kubernetes.io/projected/bef66d95-2f0c-4cf1-9f97-296f4ba9c85f-kube-api-access-kjm5n\") pod \"bef66d95-2f0c-4cf1-9f97-296f4ba9c85f\" (UID: \"bef66d95-2f0c-4cf1-9f97-296f4ba9c85f\") " Jul 30 13:04:18.305280 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:18.305245 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bef66d95-2f0c-4cf1-9f97-296f4ba9c85f-bundle" (OuterVolumeSpecName: "bundle") pod "bef66d95-2f0c-4cf1-9f97-296f4ba9c85f" (UID: "bef66d95-2f0c-4cf1-9f97-296f4ba9c85f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 13:04:18.306741 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:18.306714 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bef66d95-2f0c-4cf1-9f97-296f4ba9c85f-kube-api-access-kjm5n" (OuterVolumeSpecName: "kube-api-access-kjm5n") pod "bef66d95-2f0c-4cf1-9f97-296f4ba9c85f" (UID: "bef66d95-2f0c-4cf1-9f97-296f4ba9c85f"). InnerVolumeSpecName "kube-api-access-kjm5n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 13:04:18.309485 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:18.309407 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bef66d95-2f0c-4cf1-9f97-296f4ba9c85f-util" (OuterVolumeSpecName: "util") pod "bef66d95-2f0c-4cf1-9f97-296f4ba9c85f" (UID: "bef66d95-2f0c-4cf1-9f97-296f4ba9c85f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 13:04:18.405375 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:18.405332 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bef66d95-2f0c-4cf1-9f97-296f4ba9c85f-bundle\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 13:04:18.405375 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:18.405365 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kjm5n\" (UniqueName: \"kubernetes.io/projected/bef66d95-2f0c-4cf1-9f97-296f4ba9c85f-kube-api-access-kjm5n\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 13:04:18.405375 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:18.405377 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bef66d95-2f0c-4cf1-9f97-296f4ba9c85f-util\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 13:04:19.064862 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:19.064783 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lchkt" Jul 30 13:04:19.064862 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:19.064798 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lchkt" event={"ID":"bef66d95-2f0c-4cf1-9f97-296f4ba9c85f","Type":"ContainerDied","Data":"5e5c942942c5fa3e4543d5a2f4a197db24f600e380ec8c4db9f3ad717cb263b6"} Jul 30 13:04:19.064862 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:19.064839 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5e5c942942c5fa3e4543d5a2f4a197db24f600e380ec8c4db9f3ad717cb263b6" Jul 30 13:04:24.435370 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:24.435329 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:04:25.317385 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:25.317349 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:04:26.411970 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:26.411935 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j5462"] Jul 30 13:04:26.412351 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:26.412257 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bef66d95-2f0c-4cf1-9f97-296f4ba9c85f" containerName="pull" Jul 30 13:04:26.412351 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:26.412269 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="bef66d95-2f0c-4cf1-9f97-296f4ba9c85f" containerName="pull" Jul 30 13:04:26.412351 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:26.412280 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bef66d95-2f0c-4cf1-9f97-296f4ba9c85f" containerName="extract" Jul 30 13:04:26.412351 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:26.412286 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="bef66d95-2f0c-4cf1-9f97-296f4ba9c85f" containerName="extract" Jul 30 13:04:26.412351 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:26.412296 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bef66d95-2f0c-4cf1-9f97-296f4ba9c85f" containerName="util" Jul 30 13:04:26.412351 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:26.412302 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="bef66d95-2f0c-4cf1-9f97-296f4ba9c85f" containerName="util" Jul 30 13:04:26.412557 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:26.412357 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="bef66d95-2f0c-4cf1-9f97-296f4ba9c85f" containerName="extract" Jul 30 13:04:26.416818 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:26.416799 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j5462" Jul 30 13:04:26.419405 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:26.419381 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 30 13:04:26.419702 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:26.419685 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-jqkvn\"" Jul 30 13:04:26.419791 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:26.419704 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 30 13:04:26.429203 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:26.429179 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j5462"] Jul 30 13:04:26.480311 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:26.480267 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdrvm\" (UniqueName: \"kubernetes.io/projected/dd3b0c2c-20f3-4dad-9f2b-d420534ed470-kube-api-access-bdrvm\") pod \"cert-manager-operator-controller-manager-55c444bf86-j5462\" (UID: \"dd3b0c2c-20f3-4dad-9f2b-d420534ed470\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j5462" Jul 30 13:04:26.480523 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:26.480365 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dd3b0c2c-20f3-4dad-9f2b-d420534ed470-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-j5462\" (UID: \"dd3b0c2c-20f3-4dad-9f2b-d420534ed470\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j5462" Jul 30 13:04:26.581262 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:26.581225 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdrvm\" (UniqueName: \"kubernetes.io/projected/dd3b0c2c-20f3-4dad-9f2b-d420534ed470-kube-api-access-bdrvm\") pod \"cert-manager-operator-controller-manager-55c444bf86-j5462\" (UID: \"dd3b0c2c-20f3-4dad-9f2b-d420534ed470\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j5462" Jul 30 13:04:26.581399 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:26.581295 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dd3b0c2c-20f3-4dad-9f2b-d420534ed470-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-j5462\" (UID: \"dd3b0c2c-20f3-4dad-9f2b-d420534ed470\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j5462" Jul 30 13:04:26.581658 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:26.581643 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dd3b0c2c-20f3-4dad-9f2b-d420534ed470-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-j5462\" (UID: \"dd3b0c2c-20f3-4dad-9f2b-d420534ed470\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j5462" Jul 30 13:04:26.603386 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:26.603357 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdrvm\" (UniqueName: \"kubernetes.io/projected/dd3b0c2c-20f3-4dad-9f2b-d420534ed470-kube-api-access-bdrvm\") pod \"cert-manager-operator-controller-manager-55c444bf86-j5462\" (UID: \"dd3b0c2c-20f3-4dad-9f2b-d420534ed470\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j5462" Jul 30 13:04:26.725387 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:26.725358 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j5462" Jul 30 13:04:26.866239 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:26.866158 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j5462"] Jul 30 13:04:26.868587 ip-10-0-133-230 kubenswrapper[2579]: W0730 13:04:26.868562 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd3b0c2c_20f3_4dad_9f2b_d420534ed470.slice/crio-0a8b9bc9b9fbfbb87ad5379d9d628a4f55f99da48c0ca2bd01cdc5fe272a0d91 WatchSource:0}: Error finding container 0a8b9bc9b9fbfbb87ad5379d9d628a4f55f99da48c0ca2bd01cdc5fe272a0d91: Status 404 returned error can't find the container with id 0a8b9bc9b9fbfbb87ad5379d9d628a4f55f99da48c0ca2bd01cdc5fe272a0d91 Jul 30 13:04:26.871057 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:26.871042 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 30 13:04:27.096285 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:27.096201 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j5462" event={"ID":"dd3b0c2c-20f3-4dad-9f2b-d420534ed470","Type":"ContainerStarted","Data":"0a8b9bc9b9fbfbb87ad5379d9d628a4f55f99da48c0ca2bd01cdc5fe272a0d91"} Jul 30 13:04:28.029551 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:28.029505 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:04:28.140115 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:28.140080 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:04:29.884603 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:29.884569 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:04:30.006763 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:30.006717 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:04:30.091174 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:30.091139 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-n6tjj"] Jul 30 13:04:30.094368 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:30.094352 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-n6tjj" Jul 30 13:04:30.098149 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:30.098124 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 30 13:04:30.098302 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:30.098287 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-zdxlw\"" Jul 30 13:04:30.099347 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:30.099332 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 30 13:04:30.110203 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:30.110180 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-n6tjj"] Jul 30 13:04:30.111565 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:30.111537 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j5462" event={"ID":"dd3b0c2c-20f3-4dad-9f2b-d420534ed470","Type":"ContainerStarted","Data":"bd0d7a8a14bfa13988069a35243443c6c9304abbef7f3cde19d89c402582ad71"} Jul 30 13:04:30.114102 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:30.114079 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e4c8bb14-ba6f-4d25-833e-786fe6a4ab11-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-n6tjj\" (UID: \"e4c8bb14-ba6f-4d25-833e-786fe6a4ab11\") " pod="cert-manager/cert-manager-webhook-6486ffd997-n6tjj" Jul 30 13:04:30.114193 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:30.114129 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c24tw\" (UniqueName: \"kubernetes.io/projected/e4c8bb14-ba6f-4d25-833e-786fe6a4ab11-kube-api-access-c24tw\") pod \"cert-manager-webhook-6486ffd997-n6tjj\" (UID: \"e4c8bb14-ba6f-4d25-833e-786fe6a4ab11\") " pod="cert-manager/cert-manager-webhook-6486ffd997-n6tjj" Jul 30 13:04:30.155106 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:30.155012 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-j5462" podStartSLOduration=1.834246963 podStartE2EDuration="4.154995542s" totalImagesPullingTime="2.320748579s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:04:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:04:30.15259764 +0000 UTC m=+317.984063784" watchObservedRunningTime="2026-07-30 13:04:30.154995542 +0000 UTC m=+317.986461668" Jul 30 13:04:30.215357 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:30.215327 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c24tw\" (UniqueName: \"kubernetes.io/projected/e4c8bb14-ba6f-4d25-833e-786fe6a4ab11-kube-api-access-c24tw\") pod \"cert-manager-webhook-6486ffd997-n6tjj\" (UID: \"e4c8bb14-ba6f-4d25-833e-786fe6a4ab11\") " pod="cert-manager/cert-manager-webhook-6486ffd997-n6tjj" Jul 30 13:04:30.215578 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:30.215440 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e4c8bb14-ba6f-4d25-833e-786fe6a4ab11-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-n6tjj\" (UID: \"e4c8bb14-ba6f-4d25-833e-786fe6a4ab11\") " pod="cert-manager/cert-manager-webhook-6486ffd997-n6tjj" Jul 30 13:04:30.232755 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:30.232727 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e4c8bb14-ba6f-4d25-833e-786fe6a4ab11-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-n6tjj\" (UID: \"e4c8bb14-ba6f-4d25-833e-786fe6a4ab11\") " pod="cert-manager/cert-manager-webhook-6486ffd997-n6tjj" Jul 30 13:04:30.232872 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:30.232832 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c24tw\" (UniqueName: \"kubernetes.io/projected/e4c8bb14-ba6f-4d25-833e-786fe6a4ab11-kube-api-access-c24tw\") pod \"cert-manager-webhook-6486ffd997-n6tjj\" (UID: \"e4c8bb14-ba6f-4d25-833e-786fe6a4ab11\") " pod="cert-manager/cert-manager-webhook-6486ffd997-n6tjj" Jul 30 13:04:30.419296 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:30.419205 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-n6tjj" Jul 30 13:04:30.565427 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:30.565392 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-n6tjj"] Jul 30 13:04:30.569919 ip-10-0-133-230 kubenswrapper[2579]: W0730 13:04:30.569889 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode4c8bb14_ba6f_4d25_833e_786fe6a4ab11.slice/crio-bfde3120edec82ab890c3716cc790809beb2c7d893a70e4a7e2ddea61b40f2e6 WatchSource:0}: Error finding container bfde3120edec82ab890c3716cc790809beb2c7d893a70e4a7e2ddea61b40f2e6: Status 404 returned error can't find the container with id bfde3120edec82ab890c3716cc790809beb2c7d893a70e4a7e2ddea61b40f2e6 Jul 30 13:04:30.573446 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:30.573380 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:04:30.701407 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:30.701358 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:04:30.776776 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:30.776744 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6p87m"] Jul 30 13:04:30.781264 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:30.781244 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6p87m" Jul 30 13:04:30.789333 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:30.789311 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 30 13:04:30.789471 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:30.789374 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-kwchh\"" Jul 30 13:04:30.789579 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:30.789566 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 30 13:04:30.801087 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:30.801052 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6p87m"] Jul 30 13:04:30.820468 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:30.820436 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/baf6f44e-def5-4334-9eab-6ce51e3c1341-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6p87m\" (UID: \"baf6f44e-def5-4334-9eab-6ce51e3c1341\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6p87m" Jul 30 13:04:30.820633 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:30.820479 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/baf6f44e-def5-4334-9eab-6ce51e3c1341-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6p87m\" (UID: \"baf6f44e-def5-4334-9eab-6ce51e3c1341\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6p87m" Jul 30 13:04:30.820633 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:30.820515 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2sm8\" (UniqueName: \"kubernetes.io/projected/baf6f44e-def5-4334-9eab-6ce51e3c1341-kube-api-access-l2sm8\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6p87m\" (UID: \"baf6f44e-def5-4334-9eab-6ce51e3c1341\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6p87m" Jul 30 13:04:30.921388 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:30.921356 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/baf6f44e-def5-4334-9eab-6ce51e3c1341-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6p87m\" (UID: \"baf6f44e-def5-4334-9eab-6ce51e3c1341\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6p87m" Jul 30 13:04:30.921884 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:30.921396 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/baf6f44e-def5-4334-9eab-6ce51e3c1341-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6p87m\" (UID: \"baf6f44e-def5-4334-9eab-6ce51e3c1341\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6p87m" Jul 30 13:04:30.921884 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:30.921466 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2sm8\" (UniqueName: \"kubernetes.io/projected/baf6f44e-def5-4334-9eab-6ce51e3c1341-kube-api-access-l2sm8\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6p87m\" (UID: \"baf6f44e-def5-4334-9eab-6ce51e3c1341\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6p87m" Jul 30 13:04:30.921884 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:30.921820 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/baf6f44e-def5-4334-9eab-6ce51e3c1341-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6p87m\" (UID: \"baf6f44e-def5-4334-9eab-6ce51e3c1341\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6p87m" Jul 30 13:04:30.922012 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:30.921886 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/baf6f44e-def5-4334-9eab-6ce51e3c1341-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6p87m\" (UID: \"baf6f44e-def5-4334-9eab-6ce51e3c1341\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6p87m" Jul 30 13:04:30.933620 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:30.933592 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2sm8\" (UniqueName: \"kubernetes.io/projected/baf6f44e-def5-4334-9eab-6ce51e3c1341-kube-api-access-l2sm8\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6p87m\" (UID: \"baf6f44e-def5-4334-9eab-6ce51e3c1341\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6p87m" Jul 30 13:04:31.090531 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:31.090403 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6p87m" Jul 30 13:04:31.117344 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:31.117307 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-n6tjj" event={"ID":"e4c8bb14-ba6f-4d25-833e-786fe6a4ab11","Type":"ContainerStarted","Data":"bfde3120edec82ab890c3716cc790809beb2c7d893a70e4a7e2ddea61b40f2e6"} Jul 30 13:04:31.225450 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:31.225406 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6p87m"] Jul 30 13:04:31.227939 ip-10-0-133-230 kubenswrapper[2579]: W0730 13:04:31.227914 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbaf6f44e_def5_4334_9eab_6ce51e3c1341.slice/crio-480df195972f48fee2d54001db7487e2cb29347da643bc202055dbe9b3e82c5e WatchSource:0}: Error finding container 480df195972f48fee2d54001db7487e2cb29347da643bc202055dbe9b3e82c5e: Status 404 returned error can't find the container with id 480df195972f48fee2d54001db7487e2cb29347da643bc202055dbe9b3e82c5e Jul 30 13:04:32.089903 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:32.089865 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:04:32.122628 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:32.122587 2579 generic.go:356] "Generic (PLEG): container finished" podID="baf6f44e-def5-4334-9eab-6ce51e3c1341" containerID="7bdb8bc79f43cc4115701310da9aa89158ec72c85739f2cf6d26fbd13cc8addb" exitCode=0 Jul 30 13:04:32.122778 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:32.122672 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6p87m" event={"ID":"baf6f44e-def5-4334-9eab-6ce51e3c1341","Type":"ContainerDied","Data":"7bdb8bc79f43cc4115701310da9aa89158ec72c85739f2cf6d26fbd13cc8addb"} Jul 30 13:04:32.122778 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:32.122716 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6p87m" event={"ID":"baf6f44e-def5-4334-9eab-6ce51e3c1341","Type":"ContainerStarted","Data":"480df195972f48fee2d54001db7487e2cb29347da643bc202055dbe9b3e82c5e"} Jul 30 13:04:32.482822 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:32.482777 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:04:32.919038 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:32.918917 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-62qw2"] Jul 30 13:04:32.922979 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:32.922947 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-62qw2" Jul 30 13:04:32.925741 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:32.925711 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-5wfcn\"" Jul 30 13:04:32.930250 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:32.930219 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-62qw2"] Jul 30 13:04:32.940321 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:32.940130 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9e265d55-c526-4ab2-9767-65406083e4ee-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-62qw2\" (UID: \"9e265d55-c526-4ab2-9767-65406083e4ee\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-62qw2" Jul 30 13:04:32.940321 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:32.940173 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t48t7\" (UniqueName: \"kubernetes.io/projected/9e265d55-c526-4ab2-9767-65406083e4ee-kube-api-access-t48t7\") pod \"cert-manager-cainjector-559cdd8c87-62qw2\" (UID: \"9e265d55-c526-4ab2-9767-65406083e4ee\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-62qw2" Jul 30 13:04:33.041783 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:33.041711 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9e265d55-c526-4ab2-9767-65406083e4ee-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-62qw2\" (UID: \"9e265d55-c526-4ab2-9767-65406083e4ee\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-62qw2" Jul 30 13:04:33.041783 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:33.041761 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t48t7\" (UniqueName: \"kubernetes.io/projected/9e265d55-c526-4ab2-9767-65406083e4ee-kube-api-access-t48t7\") pod \"cert-manager-cainjector-559cdd8c87-62qw2\" (UID: \"9e265d55-c526-4ab2-9767-65406083e4ee\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-62qw2" Jul 30 13:04:33.050770 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:33.050716 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t48t7\" (UniqueName: \"kubernetes.io/projected/9e265d55-c526-4ab2-9767-65406083e4ee-kube-api-access-t48t7\") pod \"cert-manager-cainjector-559cdd8c87-62qw2\" (UID: \"9e265d55-c526-4ab2-9767-65406083e4ee\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-62qw2" Jul 30 13:04:33.051240 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:33.051193 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9e265d55-c526-4ab2-9767-65406083e4ee-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-62qw2\" (UID: \"9e265d55-c526-4ab2-9767-65406083e4ee\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-62qw2" Jul 30 13:04:33.236948 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:33.236899 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-62qw2" Jul 30 13:04:33.409482 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:33.409432 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-62qw2"] Jul 30 13:04:33.413460 ip-10-0-133-230 kubenswrapper[2579]: W0730 13:04:33.413396 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9e265d55_c526_4ab2_9767_65406083e4ee.slice/crio-49644e6d682f24e308b4ec84777cd410022cf71db369c327c979b35d2a429846 WatchSource:0}: Error finding container 49644e6d682f24e308b4ec84777cd410022cf71db369c327c979b35d2a429846: Status 404 returned error can't find the container with id 49644e6d682f24e308b4ec84777cd410022cf71db369c327c979b35d2a429846 Jul 30 13:04:34.138942 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:34.138912 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-62qw2" event={"ID":"9e265d55-c526-4ab2-9767-65406083e4ee","Type":"ContainerStarted","Data":"49644e6d682f24e308b4ec84777cd410022cf71db369c327c979b35d2a429846"} Jul 30 13:04:35.020535 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:35.020499 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:04:35.119876 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:35.119841 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:04:36.148080 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:36.148044 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-62qw2" event={"ID":"9e265d55-c526-4ab2-9767-65406083e4ee","Type":"ContainerStarted","Data":"a4229c94e4186728c37ed95b0d19c32dd6a3cd0c8a900e40243925ea88a36600"} Jul 30 13:04:36.149621 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:36.149597 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-n6tjj" event={"ID":"e4c8bb14-ba6f-4d25-833e-786fe6a4ab11","Type":"ContainerStarted","Data":"992f25e6aefb17cff060aa8a6c209e4d806db9886c0a9be5244712cf2af1de84"} Jul 30 13:04:36.149712 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:36.149696 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-n6tjj" Jul 30 13:04:36.151289 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:36.151268 2579 generic.go:356] "Generic (PLEG): container finished" podID="baf6f44e-def5-4334-9eab-6ce51e3c1341" containerID="7bbb27e1f53eea1e7bc1fb823b1422e0c1eb854f05d319347a350f91c7e96dc8" exitCode=0 Jul 30 13:04:36.151371 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:36.151292 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6p87m" event={"ID":"baf6f44e-def5-4334-9eab-6ce51e3c1341","Type":"ContainerDied","Data":"7bbb27e1f53eea1e7bc1fb823b1422e0c1eb854f05d319347a350f91c7e96dc8"} Jul 30 13:04:36.171470 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:36.171400 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-62qw2" podStartSLOduration=2.408836849 podStartE2EDuration="4.171379298s" totalImagesPullingTime="1.762542449s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:04:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:04:36.169710181 +0000 UTC m=+324.001176306" watchObservedRunningTime="2026-07-30 13:04:36.171379298 +0000 UTC m=+324.002845420" Jul 30 13:04:36.188927 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:36.188872 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-n6tjj" podStartSLOduration=1.58373387 podStartE2EDuration="6.188857602s" totalImagesPullingTime="4.605123732s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:04:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:04:36.188483488 +0000 UTC m=+324.019949614" watchObservedRunningTime="2026-07-30 13:04:36.188857602 +0000 UTC m=+324.020323727" Jul 30 13:04:37.157849 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:37.157818 2579 generic.go:356] "Generic (PLEG): container finished" podID="baf6f44e-def5-4334-9eab-6ce51e3c1341" containerID="7cb316649519386e2761713e8b24ee6397f3798ea0f34cb2e25bbdfb24fb9e97" exitCode=0 Jul 30 13:04:37.158227 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:37.157901 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6p87m" event={"ID":"baf6f44e-def5-4334-9eab-6ce51e3c1341","Type":"ContainerDied","Data":"7cb316649519386e2761713e8b24ee6397f3798ea0f34cb2e25bbdfb24fb9e97"} Jul 30 13:04:38.288161 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:38.288134 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6p87m" Jul 30 13:04:38.389496 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:38.389461 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/baf6f44e-def5-4334-9eab-6ce51e3c1341-bundle\") pod \"baf6f44e-def5-4334-9eab-6ce51e3c1341\" (UID: \"baf6f44e-def5-4334-9eab-6ce51e3c1341\") " Jul 30 13:04:38.389496 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:38.389499 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/baf6f44e-def5-4334-9eab-6ce51e3c1341-util\") pod \"baf6f44e-def5-4334-9eab-6ce51e3c1341\" (UID: \"baf6f44e-def5-4334-9eab-6ce51e3c1341\") " Jul 30 13:04:38.389707 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:38.389531 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l2sm8\" (UniqueName: \"kubernetes.io/projected/baf6f44e-def5-4334-9eab-6ce51e3c1341-kube-api-access-l2sm8\") pod \"baf6f44e-def5-4334-9eab-6ce51e3c1341\" (UID: \"baf6f44e-def5-4334-9eab-6ce51e3c1341\") " Jul 30 13:04:38.389932 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:38.389906 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/baf6f44e-def5-4334-9eab-6ce51e3c1341-bundle" (OuterVolumeSpecName: "bundle") pod "baf6f44e-def5-4334-9eab-6ce51e3c1341" (UID: "baf6f44e-def5-4334-9eab-6ce51e3c1341"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 13:04:38.391687 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:38.391668 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/baf6f44e-def5-4334-9eab-6ce51e3c1341-kube-api-access-l2sm8" (OuterVolumeSpecName: "kube-api-access-l2sm8") pod "baf6f44e-def5-4334-9eab-6ce51e3c1341" (UID: "baf6f44e-def5-4334-9eab-6ce51e3c1341"). InnerVolumeSpecName "kube-api-access-l2sm8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 13:04:38.394012 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:38.393989 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/baf6f44e-def5-4334-9eab-6ce51e3c1341-util" (OuterVolumeSpecName: "util") pod "baf6f44e-def5-4334-9eab-6ce51e3c1341" (UID: "baf6f44e-def5-4334-9eab-6ce51e3c1341"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 13:04:38.490640 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:38.490603 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/baf6f44e-def5-4334-9eab-6ce51e3c1341-bundle\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 13:04:38.490640 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:38.490634 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/baf6f44e-def5-4334-9eab-6ce51e3c1341-util\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 13:04:38.490640 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:38.490643 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l2sm8\" (UniqueName: \"kubernetes.io/projected/baf6f44e-def5-4334-9eab-6ce51e3c1341-kube-api-access-l2sm8\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 13:04:39.168516 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:39.168479 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6p87m" event={"ID":"baf6f44e-def5-4334-9eab-6ce51e3c1341","Type":"ContainerDied","Data":"480df195972f48fee2d54001db7487e2cb29347da643bc202055dbe9b3e82c5e"} Jul 30 13:04:39.168664 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:39.168536 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="480df195972f48fee2d54001db7487e2cb29347da643bc202055dbe9b3e82c5e" Jul 30 13:04:39.168664 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:39.168499 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6p87m" Jul 30 13:04:40.890747 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:40.890713 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:04:41.836945 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:41.836911 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-58g9p"] Jul 30 13:04:41.837222 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:41.837207 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="baf6f44e-def5-4334-9eab-6ce51e3c1341" containerName="util" Jul 30 13:04:41.837266 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:41.837222 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="baf6f44e-def5-4334-9eab-6ce51e3c1341" containerName="util" Jul 30 13:04:41.837266 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:41.837236 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="baf6f44e-def5-4334-9eab-6ce51e3c1341" containerName="pull" Jul 30 13:04:41.837266 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:41.837242 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="baf6f44e-def5-4334-9eab-6ce51e3c1341" containerName="pull" Jul 30 13:04:41.837266 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:41.837256 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="baf6f44e-def5-4334-9eab-6ce51e3c1341" containerName="extract" Jul 30 13:04:41.837266 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:41.837261 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="baf6f44e-def5-4334-9eab-6ce51e3c1341" containerName="extract" Jul 30 13:04:41.837433 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:41.837307 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="baf6f44e-def5-4334-9eab-6ce51e3c1341" containerName="extract" Jul 30 13:04:41.840396 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:41.840377 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-58g9p" Jul 30 13:04:41.843209 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:41.843191 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-j86p6\"" Jul 30 13:04:41.849253 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:41.849234 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-58g9p"] Jul 30 13:04:41.920578 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:41.920541 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/962d09c1-6fdf-46f4-a368-7789e8837d9c-bound-sa-token\") pod \"cert-manager-55b4d954d5-58g9p\" (UID: \"962d09c1-6fdf-46f4-a368-7789e8837d9c\") " pod="cert-manager/cert-manager-55b4d954d5-58g9p" Jul 30 13:04:41.920947 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:41.920596 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sscrv\" (UniqueName: \"kubernetes.io/projected/962d09c1-6fdf-46f4-a368-7789e8837d9c-kube-api-access-sscrv\") pod \"cert-manager-55b4d954d5-58g9p\" (UID: \"962d09c1-6fdf-46f4-a368-7789e8837d9c\") " pod="cert-manager/cert-manager-55b4d954d5-58g9p" Jul 30 13:04:42.021122 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:42.021087 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/962d09c1-6fdf-46f4-a368-7789e8837d9c-bound-sa-token\") pod \"cert-manager-55b4d954d5-58g9p\" (UID: \"962d09c1-6fdf-46f4-a368-7789e8837d9c\") " pod="cert-manager/cert-manager-55b4d954d5-58g9p" Jul 30 13:04:42.021300 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:42.021144 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sscrv\" (UniqueName: \"kubernetes.io/projected/962d09c1-6fdf-46f4-a368-7789e8837d9c-kube-api-access-sscrv\") pod \"cert-manager-55b4d954d5-58g9p\" (UID: \"962d09c1-6fdf-46f4-a368-7789e8837d9c\") " pod="cert-manager/cert-manager-55b4d954d5-58g9p" Jul 30 13:04:42.030761 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:42.030730 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/962d09c1-6fdf-46f4-a368-7789e8837d9c-bound-sa-token\") pod \"cert-manager-55b4d954d5-58g9p\" (UID: \"962d09c1-6fdf-46f4-a368-7789e8837d9c\") " pod="cert-manager/cert-manager-55b4d954d5-58g9p" Jul 30 13:04:42.030885 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:42.030785 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sscrv\" (UniqueName: \"kubernetes.io/projected/962d09c1-6fdf-46f4-a368-7789e8837d9c-kube-api-access-sscrv\") pod \"cert-manager-55b4d954d5-58g9p\" (UID: \"962d09c1-6fdf-46f4-a368-7789e8837d9c\") " pod="cert-manager/cert-manager-55b4d954d5-58g9p" Jul 30 13:04:42.150160 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:42.150063 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-58g9p" Jul 30 13:04:42.160676 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:42.160593 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-n6tjj" Jul 30 13:04:42.287114 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:42.286999 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-58g9p"] Jul 30 13:04:42.289725 ip-10-0-133-230 kubenswrapper[2579]: W0730 13:04:42.289697 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod962d09c1_6fdf_46f4_a368_7789e8837d9c.slice/crio-6dff7dc362488886c187cb018f0693ec9c2444a0268314b4304c44edeaa816a0 WatchSource:0}: Error finding container 6dff7dc362488886c187cb018f0693ec9c2444a0268314b4304c44edeaa816a0: Status 404 returned error can't find the container with id 6dff7dc362488886c187cb018f0693ec9c2444a0268314b4304c44edeaa816a0 Jul 30 13:04:42.724757 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:42.724727 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:04:42.827239 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:42.827195 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:04:43.187922 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:43.187819 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-58g9p" event={"ID":"962d09c1-6fdf-46f4-a368-7789e8837d9c","Type":"ContainerStarted","Data":"1b6b5eea56b5172dae8480613b0f0d00e0a6d1b658662614835b270ad74db31a"} Jul 30 13:04:43.187922 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:43.187865 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-58g9p" event={"ID":"962d09c1-6fdf-46f4-a368-7789e8837d9c","Type":"ContainerStarted","Data":"6dff7dc362488886c187cb018f0693ec9c2444a0268314b4304c44edeaa816a0"} Jul 30 13:04:43.207506 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:43.207452 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-58g9p" podStartSLOduration=2.207411566 podStartE2EDuration="2.207411566s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:04:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:04:43.205618 +0000 UTC m=+331.037084145" watchObservedRunningTime="2026-07-30 13:04:43.207411566 +0000 UTC m=+331.038877692" Jul 30 13:04:48.745152 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:48.745111 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:04:48.844894 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:48.844858 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:04:50.563486 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:50.563447 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnc8jd"] Jul 30 13:04:50.569585 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:50.569567 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnc8jd" Jul 30 13:04:50.572726 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:50.572700 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 30 13:04:50.572842 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:50.572700 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 30 13:04:50.572842 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:50.572706 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-kwchh\"" Jul 30 13:04:50.576523 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:50.576501 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnc8jd"] Jul 30 13:04:50.699906 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:50.699873 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a45fb44-e8e9-4084-8b90-b376d5772d12-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnc8jd\" (UID: \"7a45fb44-e8e9-4084-8b90-b376d5772d12\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnc8jd" Jul 30 13:04:50.700067 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:50.699919 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rmld\" (UniqueName: \"kubernetes.io/projected/7a45fb44-e8e9-4084-8b90-b376d5772d12-kube-api-access-9rmld\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnc8jd\" (UID: \"7a45fb44-e8e9-4084-8b90-b376d5772d12\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnc8jd" Jul 30 13:04:50.700067 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:50.700004 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a45fb44-e8e9-4084-8b90-b376d5772d12-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnc8jd\" (UID: \"7a45fb44-e8e9-4084-8b90-b376d5772d12\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnc8jd" Jul 30 13:04:50.801282 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:50.801249 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a45fb44-e8e9-4084-8b90-b376d5772d12-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnc8jd\" (UID: \"7a45fb44-e8e9-4084-8b90-b376d5772d12\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnc8jd" Jul 30 13:04:50.801466 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:50.801286 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a45fb44-e8e9-4084-8b90-b376d5772d12-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnc8jd\" (UID: \"7a45fb44-e8e9-4084-8b90-b376d5772d12\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnc8jd" Jul 30 13:04:50.801466 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:50.801324 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rmld\" (UniqueName: \"kubernetes.io/projected/7a45fb44-e8e9-4084-8b90-b376d5772d12-kube-api-access-9rmld\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnc8jd\" (UID: \"7a45fb44-e8e9-4084-8b90-b376d5772d12\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnc8jd" Jul 30 13:04:50.801682 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:50.801663 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a45fb44-e8e9-4084-8b90-b376d5772d12-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnc8jd\" (UID: \"7a45fb44-e8e9-4084-8b90-b376d5772d12\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnc8jd" Jul 30 13:04:50.801759 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:50.801695 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a45fb44-e8e9-4084-8b90-b376d5772d12-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnc8jd\" (UID: \"7a45fb44-e8e9-4084-8b90-b376d5772d12\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnc8jd" Jul 30 13:04:50.812300 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:50.812266 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rmld\" (UniqueName: \"kubernetes.io/projected/7a45fb44-e8e9-4084-8b90-b376d5772d12-kube-api-access-9rmld\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnc8jd\" (UID: \"7a45fb44-e8e9-4084-8b90-b376d5772d12\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnc8jd" Jul 30 13:04:50.814755 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:50.814688 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:04:50.880165 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:50.880126 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnc8jd" Jul 30 13:04:51.016527 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:51.016447 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnc8jd"] Jul 30 13:04:51.018466 ip-10-0-133-230 kubenswrapper[2579]: W0730 13:04:51.018438 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a45fb44_e8e9_4084_8b90_b376d5772d12.slice/crio-896a62d0b2ba4f7c2f21c127ff7707bf067d2ccfd703b75c59cd545f6db67c9a WatchSource:0}: Error finding container 896a62d0b2ba4f7c2f21c127ff7707bf067d2ccfd703b75c59cd545f6db67c9a: Status 404 returned error can't find the container with id 896a62d0b2ba4f7c2f21c127ff7707bf067d2ccfd703b75c59cd545f6db67c9a Jul 30 13:04:51.229998 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:51.229962 2579 generic.go:356] "Generic (PLEG): container finished" podID="7a45fb44-e8e9-4084-8b90-b376d5772d12" containerID="370df057ed8a2db234870df4f99fd8e7f41a8f71bd1c24d2dcdf56c245ac998a" exitCode=0 Jul 30 13:04:51.230193 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:51.230009 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnc8jd" event={"ID":"7a45fb44-e8e9-4084-8b90-b376d5772d12","Type":"ContainerDied","Data":"370df057ed8a2db234870df4f99fd8e7f41a8f71bd1c24d2dcdf56c245ac998a"} Jul 30 13:04:51.230193 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:51.230051 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnc8jd" event={"ID":"7a45fb44-e8e9-4084-8b90-b376d5772d12","Type":"ContainerStarted","Data":"896a62d0b2ba4f7c2f21c127ff7707bf067d2ccfd703b75c59cd545f6db67c9a"} Jul 30 13:04:52.236225 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:52.236188 2579 generic.go:356] "Generic (PLEG): container finished" podID="7a45fb44-e8e9-4084-8b90-b376d5772d12" containerID="8ed1d8611479bd5a096a5ec398d7170caff98e0583b9840abfefe4c4f7639bea" exitCode=0 Jul 30 13:04:52.236605 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:52.236275 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnc8jd" event={"ID":"7a45fb44-e8e9-4084-8b90-b376d5772d12","Type":"ContainerDied","Data":"8ed1d8611479bd5a096a5ec398d7170caff98e0583b9840abfefe4c4f7639bea"} Jul 30 13:04:53.242452 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:53.242401 2579 generic.go:356] "Generic (PLEG): container finished" podID="7a45fb44-e8e9-4084-8b90-b376d5772d12" containerID="72019ae2b3fbf47e1f1d59f388a890fe24901840404a3ab54dc048eab7e62f34" exitCode=0 Jul 30 13:04:53.242857 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:53.242471 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnc8jd" event={"ID":"7a45fb44-e8e9-4084-8b90-b376d5772d12","Type":"ContainerDied","Data":"72019ae2b3fbf47e1f1d59f388a890fe24901840404a3ab54dc048eab7e62f34"} Jul 30 13:04:54.373340 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:54.373310 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnc8jd" Jul 30 13:04:54.536744 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:54.536656 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9rmld\" (UniqueName: \"kubernetes.io/projected/7a45fb44-e8e9-4084-8b90-b376d5772d12-kube-api-access-9rmld\") pod \"7a45fb44-e8e9-4084-8b90-b376d5772d12\" (UID: \"7a45fb44-e8e9-4084-8b90-b376d5772d12\") " Jul 30 13:04:54.536744 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:54.536705 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a45fb44-e8e9-4084-8b90-b376d5772d12-util\") pod \"7a45fb44-e8e9-4084-8b90-b376d5772d12\" (UID: \"7a45fb44-e8e9-4084-8b90-b376d5772d12\") " Jul 30 13:04:54.536744 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:54.536744 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a45fb44-e8e9-4084-8b90-b376d5772d12-bundle\") pod \"7a45fb44-e8e9-4084-8b90-b376d5772d12\" (UID: \"7a45fb44-e8e9-4084-8b90-b376d5772d12\") " Jul 30 13:04:54.537522 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:54.537497 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a45fb44-e8e9-4084-8b90-b376d5772d12-bundle" (OuterVolumeSpecName: "bundle") pod "7a45fb44-e8e9-4084-8b90-b376d5772d12" (UID: "7a45fb44-e8e9-4084-8b90-b376d5772d12"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 13:04:54.538775 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:54.538753 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a45fb44-e8e9-4084-8b90-b376d5772d12-kube-api-access-9rmld" (OuterVolumeSpecName: "kube-api-access-9rmld") pod "7a45fb44-e8e9-4084-8b90-b376d5772d12" (UID: "7a45fb44-e8e9-4084-8b90-b376d5772d12"). InnerVolumeSpecName "kube-api-access-9rmld". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 13:04:54.542539 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:54.542514 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a45fb44-e8e9-4084-8b90-b376d5772d12-util" (OuterVolumeSpecName: "util") pod "7a45fb44-e8e9-4084-8b90-b376d5772d12" (UID: "7a45fb44-e8e9-4084-8b90-b376d5772d12"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 13:04:54.637355 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:54.637307 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a45fb44-e8e9-4084-8b90-b376d5772d12-util\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 13:04:54.637355 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:54.637348 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a45fb44-e8e9-4084-8b90-b376d5772d12-bundle\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 13:04:54.637355 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:54.637359 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9rmld\" (UniqueName: \"kubernetes.io/projected/7a45fb44-e8e9-4084-8b90-b376d5772d12-kube-api-access-9rmld\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 13:04:55.253054 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:55.253026 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnc8jd" Jul 30 13:04:55.253253 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:55.253025 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnc8jd" event={"ID":"7a45fb44-e8e9-4084-8b90-b376d5772d12","Type":"ContainerDied","Data":"896a62d0b2ba4f7c2f21c127ff7707bf067d2ccfd703b75c59cd545f6db67c9a"} Jul 30 13:04:55.253253 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:04:55.253155 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="896a62d0b2ba4f7c2f21c127ff7707bf067d2ccfd703b75c59cd545f6db67c9a" Jul 30 13:05:02.502188 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:02.502150 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:05:03.670737 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:03.670692 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6bd55cb6f4-xcfbz"] Jul 30 13:05:03.671123 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:03.671036 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a45fb44-e8e9-4084-8b90-b376d5772d12" containerName="pull" Jul 30 13:05:03.671123 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:03.671050 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a45fb44-e8e9-4084-8b90-b376d5772d12" containerName="pull" Jul 30 13:05:03.671123 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:03.671060 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a45fb44-e8e9-4084-8b90-b376d5772d12" containerName="extract" Jul 30 13:05:03.671123 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:03.671066 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a45fb44-e8e9-4084-8b90-b376d5772d12" containerName="extract" Jul 30 13:05:03.671123 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:03.671078 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a45fb44-e8e9-4084-8b90-b376d5772d12" containerName="util" Jul 30 13:05:03.671123 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:03.671084 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a45fb44-e8e9-4084-8b90-b376d5772d12" containerName="util" Jul 30 13:05:03.671306 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:03.671152 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a45fb44-e8e9-4084-8b90-b376d5772d12" containerName="extract" Jul 30 13:05:03.674470 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:03.674452 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6bd55cb6f4-xcfbz" Jul 30 13:05:03.677306 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:03.677284 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-cwt6z\"" Jul 30 13:05:03.677485 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:03.677466 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 30 13:05:03.677739 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:03.677726 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 30 13:05:03.678186 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:03.678174 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 30 13:05:03.678481 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:03.678466 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 30 13:05:03.695037 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:03.695010 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6bd55cb6f4-xcfbz"] Jul 30 13:05:03.814247 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:03.814210 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e7988f8a-ec3f-41fa-a517-9ca561628770-webhook-cert\") pod \"opendatahub-operator-controller-manager-6bd55cb6f4-xcfbz\" (UID: \"e7988f8a-ec3f-41fa-a517-9ca561628770\") " pod="opendatahub/opendatahub-operator-controller-manager-6bd55cb6f4-xcfbz" Jul 30 13:05:03.814434 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:03.814270 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e7988f8a-ec3f-41fa-a517-9ca561628770-tmp\") pod \"opendatahub-operator-controller-manager-6bd55cb6f4-xcfbz\" (UID: \"e7988f8a-ec3f-41fa-a517-9ca561628770\") " pod="opendatahub/opendatahub-operator-controller-manager-6bd55cb6f4-xcfbz" Jul 30 13:05:03.814434 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:03.814356 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e7988f8a-ec3f-41fa-a517-9ca561628770-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6bd55cb6f4-xcfbz\" (UID: \"e7988f8a-ec3f-41fa-a517-9ca561628770\") " pod="opendatahub/opendatahub-operator-controller-manager-6bd55cb6f4-xcfbz" Jul 30 13:05:03.814519 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:03.814435 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e7988f8a-ec3f-41fa-a517-9ca561628770-manifests\") pod \"opendatahub-operator-controller-manager-6bd55cb6f4-xcfbz\" (UID: \"e7988f8a-ec3f-41fa-a517-9ca561628770\") " pod="opendatahub/opendatahub-operator-controller-manager-6bd55cb6f4-xcfbz" Jul 30 13:05:03.814519 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:03.814481 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjp6l\" (UniqueName: \"kubernetes.io/projected/e7988f8a-ec3f-41fa-a517-9ca561628770-kube-api-access-kjp6l\") pod \"opendatahub-operator-controller-manager-6bd55cb6f4-xcfbz\" (UID: \"e7988f8a-ec3f-41fa-a517-9ca561628770\") " pod="opendatahub/opendatahub-operator-controller-manager-6bd55cb6f4-xcfbz" Jul 30 13:05:03.915851 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:03.915810 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e7988f8a-ec3f-41fa-a517-9ca561628770-tmp\") pod \"opendatahub-operator-controller-manager-6bd55cb6f4-xcfbz\" (UID: \"e7988f8a-ec3f-41fa-a517-9ca561628770\") " pod="opendatahub/opendatahub-operator-controller-manager-6bd55cb6f4-xcfbz" Jul 30 13:05:03.916014 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:03.915868 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e7988f8a-ec3f-41fa-a517-9ca561628770-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6bd55cb6f4-xcfbz\" (UID: \"e7988f8a-ec3f-41fa-a517-9ca561628770\") " pod="opendatahub/opendatahub-operator-controller-manager-6bd55cb6f4-xcfbz" Jul 30 13:05:03.916014 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:03.915897 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e7988f8a-ec3f-41fa-a517-9ca561628770-manifests\") pod \"opendatahub-operator-controller-manager-6bd55cb6f4-xcfbz\" (UID: \"e7988f8a-ec3f-41fa-a517-9ca561628770\") " pod="opendatahub/opendatahub-operator-controller-manager-6bd55cb6f4-xcfbz" Jul 30 13:05:03.916014 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:03.915935 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjp6l\" (UniqueName: \"kubernetes.io/projected/e7988f8a-ec3f-41fa-a517-9ca561628770-kube-api-access-kjp6l\") pod \"opendatahub-operator-controller-manager-6bd55cb6f4-xcfbz\" (UID: \"e7988f8a-ec3f-41fa-a517-9ca561628770\") " pod="opendatahub/opendatahub-operator-controller-manager-6bd55cb6f4-xcfbz" Jul 30 13:05:03.916014 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:03.915990 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e7988f8a-ec3f-41fa-a517-9ca561628770-webhook-cert\") pod \"opendatahub-operator-controller-manager-6bd55cb6f4-xcfbz\" (UID: \"e7988f8a-ec3f-41fa-a517-9ca561628770\") " pod="opendatahub/opendatahub-operator-controller-manager-6bd55cb6f4-xcfbz" Jul 30 13:05:03.916405 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:03.916376 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e7988f8a-ec3f-41fa-a517-9ca561628770-manifests\") pod \"opendatahub-operator-controller-manager-6bd55cb6f4-xcfbz\" (UID: \"e7988f8a-ec3f-41fa-a517-9ca561628770\") " pod="opendatahub/opendatahub-operator-controller-manager-6bd55cb6f4-xcfbz" Jul 30 13:05:03.918193 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:03.918164 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e7988f8a-ec3f-41fa-a517-9ca561628770-tmp\") pod \"opendatahub-operator-controller-manager-6bd55cb6f4-xcfbz\" (UID: \"e7988f8a-ec3f-41fa-a517-9ca561628770\") " pod="opendatahub/opendatahub-operator-controller-manager-6bd55cb6f4-xcfbz" Jul 30 13:05:03.918469 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:03.918450 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e7988f8a-ec3f-41fa-a517-9ca561628770-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6bd55cb6f4-xcfbz\" (UID: \"e7988f8a-ec3f-41fa-a517-9ca561628770\") " pod="opendatahub/opendatahub-operator-controller-manager-6bd55cb6f4-xcfbz" Jul 30 13:05:03.918557 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:03.918538 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e7988f8a-ec3f-41fa-a517-9ca561628770-webhook-cert\") pod \"opendatahub-operator-controller-manager-6bd55cb6f4-xcfbz\" (UID: \"e7988f8a-ec3f-41fa-a517-9ca561628770\") " pod="opendatahub/opendatahub-operator-controller-manager-6bd55cb6f4-xcfbz" Jul 30 13:05:03.936843 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:03.936789 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjp6l\" (UniqueName: \"kubernetes.io/projected/e7988f8a-ec3f-41fa-a517-9ca561628770-kube-api-access-kjp6l\") pod \"opendatahub-operator-controller-manager-6bd55cb6f4-xcfbz\" (UID: \"e7988f8a-ec3f-41fa-a517-9ca561628770\") " pod="opendatahub/opendatahub-operator-controller-manager-6bd55cb6f4-xcfbz" Jul 30 13:05:03.985783 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:03.985742 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6bd55cb6f4-xcfbz" Jul 30 13:05:04.154133 ip-10-0-133-230 kubenswrapper[2579]: W0730 13:05:04.154095 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7988f8a_ec3f_41fa_a517_9ca561628770.slice/crio-4a918cc93d2012147c8eb308eb658f0de1e2ea4890e122395d77828de3894c2a WatchSource:0}: Error finding container 4a918cc93d2012147c8eb308eb658f0de1e2ea4890e122395d77828de3894c2a: Status 404 returned error can't find the container with id 4a918cc93d2012147c8eb308eb658f0de1e2ea4890e122395d77828de3894c2a Jul 30 13:05:04.154268 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:04.154187 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6bd55cb6f4-xcfbz"] Jul 30 13:05:04.295477 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:04.295440 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6bd55cb6f4-xcfbz" event={"ID":"e7988f8a-ec3f-41fa-a517-9ca561628770","Type":"ContainerStarted","Data":"4a918cc93d2012147c8eb308eb658f0de1e2ea4890e122395d77828de3894c2a"} Jul 30 13:05:04.368181 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:04.368151 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:05:04.468655 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:04.468612 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:05:08.318333 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:08.318290 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6bd55cb6f4-xcfbz" event={"ID":"e7988f8a-ec3f-41fa-a517-9ca561628770","Type":"ContainerStarted","Data":"5b5182e148b6006e3db11a747176394421dc28bd20468b9bb361b232748602f1"} Jul 30 13:05:09.324516 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:09.324481 2579 generic.go:356] "Generic (PLEG): container finished" podID="e7988f8a-ec3f-41fa-a517-9ca561628770" containerID="5b5182e148b6006e3db11a747176394421dc28bd20468b9bb361b232748602f1" exitCode=0 Jul 30 13:05:09.324914 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:09.324569 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6bd55cb6f4-xcfbz" event={"ID":"e7988f8a-ec3f-41fa-a517-9ca561628770","Type":"ContainerDied","Data":"5b5182e148b6006e3db11a747176394421dc28bd20468b9bb361b232748602f1"} Jul 30 13:05:10.331468 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:10.331431 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6bd55cb6f4-xcfbz" event={"ID":"e7988f8a-ec3f-41fa-a517-9ca561628770","Type":"ContainerStarted","Data":"fef320edb68a3f13a8139dcf80c9e6fe34ecb23ade70d122fe5860d0dcde353e"} Jul 30 13:05:10.331896 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:10.331491 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6bd55cb6f4-xcfbz" Jul 30 13:05:10.356200 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:10.356149 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6bd55cb6f4-xcfbz" podStartSLOduration=2.487272003 podStartE2EDuration="7.356136234s" totalImagesPullingTime="3.74516859s" totalInitContainerRuntime="1.123695641s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:05:03 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:05:10.354010453 +0000 UTC m=+358.185476578" watchObservedRunningTime="2026-07-30 13:05:10.356136234 +0000 UTC m=+358.187602358" Jul 30 13:05:12.539525 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:12.539490 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:05:12.641083 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:12.641049 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:05:19.219385 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:19.219319 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:05:19.325481 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:19.325442 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:05:21.224861 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:21.224825 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-d8f5f8447-9kzh9"] Jul 30 13:05:21.241127 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:21.241091 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-d8f5f8447-9kzh9"] Jul 30 13:05:21.241270 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:21.241217 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-d8f5f8447-9kzh9" Jul 30 13:05:21.245473 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:21.245449 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 30 13:05:21.245634 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:21.245450 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 30 13:05:21.245634 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:21.245450 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-5xxkh\"" Jul 30 13:05:21.245634 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:21.245450 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 30 13:05:21.245814 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:21.245788 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 30 13:05:21.245871 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:21.245850 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 30 13:05:21.270994 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:21.270962 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/26760e0a-0c28-424b-bec4-f78d0f7b412f-cert\") pod \"lws-controller-manager-d8f5f8447-9kzh9\" (UID: \"26760e0a-0c28-424b-bec4-f78d0f7b412f\") " pod="openshift-lws-operator/lws-controller-manager-d8f5f8447-9kzh9" Jul 30 13:05:21.271138 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:21.271010 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/26760e0a-0c28-424b-bec4-f78d0f7b412f-metrics-cert\") pod \"lws-controller-manager-d8f5f8447-9kzh9\" (UID: \"26760e0a-0c28-424b-bec4-f78d0f7b412f\") " pod="openshift-lws-operator/lws-controller-manager-d8f5f8447-9kzh9" Jul 30 13:05:21.271138 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:21.271072 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/26760e0a-0c28-424b-bec4-f78d0f7b412f-manager-config\") pod \"lws-controller-manager-d8f5f8447-9kzh9\" (UID: \"26760e0a-0c28-424b-bec4-f78d0f7b412f\") " pod="openshift-lws-operator/lws-controller-manager-d8f5f8447-9kzh9" Jul 30 13:05:21.271234 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:21.271140 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xb8px\" (UniqueName: \"kubernetes.io/projected/26760e0a-0c28-424b-bec4-f78d0f7b412f-kube-api-access-xb8px\") pod \"lws-controller-manager-d8f5f8447-9kzh9\" (UID: \"26760e0a-0c28-424b-bec4-f78d0f7b412f\") " pod="openshift-lws-operator/lws-controller-manager-d8f5f8447-9kzh9" Jul 30 13:05:21.337866 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:21.337834 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6bd55cb6f4-xcfbz" Jul 30 13:05:21.372616 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:21.372580 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/26760e0a-0c28-424b-bec4-f78d0f7b412f-cert\") pod \"lws-controller-manager-d8f5f8447-9kzh9\" (UID: \"26760e0a-0c28-424b-bec4-f78d0f7b412f\") " pod="openshift-lws-operator/lws-controller-manager-d8f5f8447-9kzh9" Jul 30 13:05:21.372827 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:21.372636 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/26760e0a-0c28-424b-bec4-f78d0f7b412f-metrics-cert\") pod \"lws-controller-manager-d8f5f8447-9kzh9\" (UID: \"26760e0a-0c28-424b-bec4-f78d0f7b412f\") " pod="openshift-lws-operator/lws-controller-manager-d8f5f8447-9kzh9" Jul 30 13:05:21.372827 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:21.372769 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/26760e0a-0c28-424b-bec4-f78d0f7b412f-manager-config\") pod \"lws-controller-manager-d8f5f8447-9kzh9\" (UID: \"26760e0a-0c28-424b-bec4-f78d0f7b412f\") " pod="openshift-lws-operator/lws-controller-manager-d8f5f8447-9kzh9" Jul 30 13:05:21.372827 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:21.372806 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xb8px\" (UniqueName: \"kubernetes.io/projected/26760e0a-0c28-424b-bec4-f78d0f7b412f-kube-api-access-xb8px\") pod \"lws-controller-manager-d8f5f8447-9kzh9\" (UID: \"26760e0a-0c28-424b-bec4-f78d0f7b412f\") " pod="openshift-lws-operator/lws-controller-manager-d8f5f8447-9kzh9" Jul 30 13:05:21.373492 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:21.373465 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/26760e0a-0c28-424b-bec4-f78d0f7b412f-manager-config\") pod \"lws-controller-manager-d8f5f8447-9kzh9\" (UID: \"26760e0a-0c28-424b-bec4-f78d0f7b412f\") " pod="openshift-lws-operator/lws-controller-manager-d8f5f8447-9kzh9" Jul 30 13:05:21.375326 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:21.375297 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/26760e0a-0c28-424b-bec4-f78d0f7b412f-metrics-cert\") pod \"lws-controller-manager-d8f5f8447-9kzh9\" (UID: \"26760e0a-0c28-424b-bec4-f78d0f7b412f\") " pod="openshift-lws-operator/lws-controller-manager-d8f5f8447-9kzh9" Jul 30 13:05:21.375477 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:21.375393 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/26760e0a-0c28-424b-bec4-f78d0f7b412f-cert\") pod \"lws-controller-manager-d8f5f8447-9kzh9\" (UID: \"26760e0a-0c28-424b-bec4-f78d0f7b412f\") " pod="openshift-lws-operator/lws-controller-manager-d8f5f8447-9kzh9" Jul 30 13:05:21.385127 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:21.385095 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xb8px\" (UniqueName: \"kubernetes.io/projected/26760e0a-0c28-424b-bec4-f78d0f7b412f-kube-api-access-xb8px\") pod \"lws-controller-manager-d8f5f8447-9kzh9\" (UID: \"26760e0a-0c28-424b-bec4-f78d0f7b412f\") " pod="openshift-lws-operator/lws-controller-manager-d8f5f8447-9kzh9" Jul 30 13:05:21.551480 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:21.551386 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-d8f5f8447-9kzh9" Jul 30 13:05:21.723120 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:21.723080 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-d8f5f8447-9kzh9"] Jul 30 13:05:21.726023 ip-10-0-133-230 kubenswrapper[2579]: W0730 13:05:21.725991 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26760e0a_0c28_424b_bec4_f78d0f7b412f.slice/crio-b114f22008ca4679d65d44147aa7861b0895d97c85e6214a164dadaa60425c75 WatchSource:0}: Error finding container b114f22008ca4679d65d44147aa7861b0895d97c85e6214a164dadaa60425c75: Status 404 returned error can't find the container with id b114f22008ca4679d65d44147aa7861b0895d97c85e6214a164dadaa60425c75 Jul 30 13:05:22.390015 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:22.389977 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-d8f5f8447-9kzh9" event={"ID":"26760e0a-0c28-424b-bec4-f78d0f7b412f","Type":"ContainerStarted","Data":"b114f22008ca4679d65d44147aa7861b0895d97c85e6214a164dadaa60425c75"} Jul 30 13:05:24.402220 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:24.402182 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-d8f5f8447-9kzh9" event={"ID":"26760e0a-0c28-424b-bec4-f78d0f7b412f","Type":"ContainerStarted","Data":"b6e172be5c2e99f58e1b1dba949d718a451021c94747121241044bc12e8a8789"} Jul 30 13:05:24.402671 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:24.402246 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-d8f5f8447-9kzh9" Jul 30 13:05:24.470983 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:24.470927 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-d8f5f8447-9kzh9" podStartSLOduration=1.6900408279999999 podStartE2EDuration="3.470909321s" totalImagesPullingTime="1.780868493s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:05:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:05:24.466797278 +0000 UTC m=+372.298263404" watchObservedRunningTime="2026-07-30 13:05:24.470909321 +0000 UTC m=+372.302375446" Jul 30 13:05:24.752635 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:24.752603 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:05:24.878738 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:24.878697 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:05:25.205058 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:25.205029 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:05:25.561892 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:25.561808 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:05:25.674005 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:25.673966 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:05:25.770796 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:25.770757 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:05:25.875315 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:25.875215 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:05:26.259649 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:26.259609 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:05:26.711138 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:26.711101 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:05:26.902688 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:26.902658 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:05:26.996011 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:26.995927 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:05:27.988987 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:27.988948 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:05:32.090396 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:32.090346 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:05:32.175782 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:32.175745 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:05:32.724639 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:32.724608 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-cch52"] Jul 30 13:05:32.728356 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:32.728335 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-cch52" Jul 30 13:05:32.731386 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:32.731358 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 30 13:05:32.731386 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:32.731368 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-rpt87\"" Jul 30 13:05:32.745985 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:32.745958 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-cch52"] Jul 30 13:05:32.767433 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:32.767381 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:05:32.777396 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:32.777373 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed205912-55a1-484b-bf85-f76d5ceadfc7-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-cch52\" (UID: \"ed205912-55a1-484b-bf85-f76d5ceadfc7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-cch52" Jul 30 13:05:32.777514 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:32.777401 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbp2v\" (UniqueName: \"kubernetes.io/projected/ed205912-55a1-484b-bf85-f76d5ceadfc7-kube-api-access-fbp2v\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-cch52\" (UID: \"ed205912-55a1-484b-bf85-f76d5ceadfc7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-cch52" Jul 30 13:05:32.777514 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:32.777467 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed205912-55a1-484b-bf85-f76d5ceadfc7-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-cch52\" (UID: \"ed205912-55a1-484b-bf85-f76d5ceadfc7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-cch52" Jul 30 13:05:32.777514 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:32.777509 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed205912-55a1-484b-bf85-f76d5ceadfc7-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-cch52\" (UID: \"ed205912-55a1-484b-bf85-f76d5ceadfc7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-cch52" Jul 30 13:05:32.777631 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:32.777549 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed205912-55a1-484b-bf85-f76d5ceadfc7-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-cch52\" (UID: \"ed205912-55a1-484b-bf85-f76d5ceadfc7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-cch52" Jul 30 13:05:32.777631 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:32.777593 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed205912-55a1-484b-bf85-f76d5ceadfc7-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-cch52\" (UID: \"ed205912-55a1-484b-bf85-f76d5ceadfc7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-cch52" Jul 30 13:05:32.777631 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:32.777609 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed205912-55a1-484b-bf85-f76d5ceadfc7-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-cch52\" (UID: \"ed205912-55a1-484b-bf85-f76d5ceadfc7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-cch52" Jul 30 13:05:32.777735 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:32.777632 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed205912-55a1-484b-bf85-f76d5ceadfc7-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-cch52\" (UID: \"ed205912-55a1-484b-bf85-f76d5ceadfc7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-cch52" Jul 30 13:05:32.777735 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:32.777646 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed205912-55a1-484b-bf85-f76d5ceadfc7-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-cch52\" (UID: \"ed205912-55a1-484b-bf85-f76d5ceadfc7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-cch52" Jul 30 13:05:32.878727 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:32.878681 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed205912-55a1-484b-bf85-f76d5ceadfc7-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-cch52\" (UID: \"ed205912-55a1-484b-bf85-f76d5ceadfc7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-cch52" Jul 30 13:05:32.878924 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:32.878749 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed205912-55a1-484b-bf85-f76d5ceadfc7-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-cch52\" (UID: \"ed205912-55a1-484b-bf85-f76d5ceadfc7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-cch52" Jul 30 13:05:32.878924 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:32.878789 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed205912-55a1-484b-bf85-f76d5ceadfc7-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-cch52\" (UID: \"ed205912-55a1-484b-bf85-f76d5ceadfc7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-cch52" Jul 30 13:05:32.878924 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:32.878812 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed205912-55a1-484b-bf85-f76d5ceadfc7-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-cch52\" (UID: \"ed205912-55a1-484b-bf85-f76d5ceadfc7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-cch52" Jul 30 13:05:32.878924 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:32.878844 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed205912-55a1-484b-bf85-f76d5ceadfc7-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-cch52\" (UID: \"ed205912-55a1-484b-bf85-f76d5ceadfc7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-cch52" Jul 30 13:05:32.878924 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:32.878866 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed205912-55a1-484b-bf85-f76d5ceadfc7-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-cch52\" (UID: \"ed205912-55a1-484b-bf85-f76d5ceadfc7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-cch52" Jul 30 13:05:32.878924 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:32.878922 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed205912-55a1-484b-bf85-f76d5ceadfc7-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-cch52\" (UID: \"ed205912-55a1-484b-bf85-f76d5ceadfc7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-cch52" Jul 30 13:05:32.879215 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:32.878945 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbp2v\" (UniqueName: \"kubernetes.io/projected/ed205912-55a1-484b-bf85-f76d5ceadfc7-kube-api-access-fbp2v\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-cch52\" (UID: \"ed205912-55a1-484b-bf85-f76d5ceadfc7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-cch52" Jul 30 13:05:32.879215 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:32.878972 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed205912-55a1-484b-bf85-f76d5ceadfc7-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-cch52\" (UID: \"ed205912-55a1-484b-bf85-f76d5ceadfc7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-cch52" Jul 30 13:05:32.879320 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:32.879296 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed205912-55a1-484b-bf85-f76d5ceadfc7-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-cch52\" (UID: \"ed205912-55a1-484b-bf85-f76d5ceadfc7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-cch52" Jul 30 13:05:32.879380 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:32.879358 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed205912-55a1-484b-bf85-f76d5ceadfc7-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-cch52\" (UID: \"ed205912-55a1-484b-bf85-f76d5ceadfc7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-cch52" Jul 30 13:05:32.879472 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:32.879454 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed205912-55a1-484b-bf85-f76d5ceadfc7-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-cch52\" (UID: \"ed205912-55a1-484b-bf85-f76d5ceadfc7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-cch52" Jul 30 13:05:32.879563 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:32.879541 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed205912-55a1-484b-bf85-f76d5ceadfc7-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-cch52\" (UID: \"ed205912-55a1-484b-bf85-f76d5ceadfc7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-cch52" Jul 30 13:05:32.879717 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:32.879697 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed205912-55a1-484b-bf85-f76d5ceadfc7-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-cch52\" (UID: \"ed205912-55a1-484b-bf85-f76d5ceadfc7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-cch52" Jul 30 13:05:32.881095 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:32.881068 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed205912-55a1-484b-bf85-f76d5ceadfc7-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-cch52\" (UID: \"ed205912-55a1-484b-bf85-f76d5ceadfc7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-cch52" Jul 30 13:05:32.881428 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:32.881397 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed205912-55a1-484b-bf85-f76d5ceadfc7-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-cch52\" (UID: \"ed205912-55a1-484b-bf85-f76d5ceadfc7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-cch52" Jul 30 13:05:32.898065 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:32.898026 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed205912-55a1-484b-bf85-f76d5ceadfc7-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-cch52\" (UID: \"ed205912-55a1-484b-bf85-f76d5ceadfc7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-cch52" Jul 30 13:05:32.898191 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:32.898089 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbp2v\" (UniqueName: \"kubernetes.io/projected/ed205912-55a1-484b-bf85-f76d5ceadfc7-kube-api-access-fbp2v\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-cch52\" (UID: \"ed205912-55a1-484b-bf85-f76d5ceadfc7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-cch52" Jul 30 13:05:32.953402 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:32.953365 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-xz75p"] Jul 30 13:05:32.958006 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:32.957984 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xz75p" Jul 30 13:05:32.961376 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:32.961358 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 30 13:05:32.961767 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:32.961750 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 30 13:05:32.962310 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:32.962286 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 30 13:05:32.962851 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:32.962816 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-f2lrp\"" Jul 30 13:05:32.996315 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:32.996245 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-xz75p"] Jul 30 13:05:33.043771 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:33.043737 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-cch52" Jul 30 13:05:33.080172 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:33.080138 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/86ada943-10c1-4872-85f2-1295a2e95aeb-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-xz75p\" (UID: \"86ada943-10c1-4872-85f2-1295a2e95aeb\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xz75p" Jul 30 13:05:33.080337 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:33.080178 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8t7vk\" (UniqueName: \"kubernetes.io/projected/86ada943-10c1-4872-85f2-1295a2e95aeb-kube-api-access-8t7vk\") pod \"istiod-openshift-gateway-5677ccb49b-xz75p\" (UID: \"86ada943-10c1-4872-85f2-1295a2e95aeb\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xz75p" Jul 30 13:05:33.080337 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:33.080202 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/86ada943-10c1-4872-85f2-1295a2e95aeb-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-xz75p\" (UID: \"86ada943-10c1-4872-85f2-1295a2e95aeb\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xz75p" Jul 30 13:05:33.080337 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:33.080298 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/86ada943-10c1-4872-85f2-1295a2e95aeb-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-xz75p\" (UID: \"86ada943-10c1-4872-85f2-1295a2e95aeb\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xz75p" Jul 30 13:05:33.080486 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:33.080344 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/86ada943-10c1-4872-85f2-1295a2e95aeb-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-xz75p\" (UID: \"86ada943-10c1-4872-85f2-1295a2e95aeb\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xz75p" Jul 30 13:05:33.080486 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:33.080469 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/86ada943-10c1-4872-85f2-1295a2e95aeb-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-xz75p\" (UID: \"86ada943-10c1-4872-85f2-1295a2e95aeb\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xz75p" Jul 30 13:05:33.080562 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:33.080502 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/86ada943-10c1-4872-85f2-1295a2e95aeb-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-xz75p\" (UID: \"86ada943-10c1-4872-85f2-1295a2e95aeb\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xz75p" Jul 30 13:05:33.108370 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:33.108336 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:05:33.181702 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:33.181506 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/86ada943-10c1-4872-85f2-1295a2e95aeb-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-xz75p\" (UID: \"86ada943-10c1-4872-85f2-1295a2e95aeb\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xz75p" Jul 30 13:05:33.181702 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:33.181546 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/86ada943-10c1-4872-85f2-1295a2e95aeb-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-xz75p\" (UID: \"86ada943-10c1-4872-85f2-1295a2e95aeb\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xz75p" Jul 30 13:05:33.181702 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:33.181589 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/86ada943-10c1-4872-85f2-1295a2e95aeb-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-xz75p\" (UID: \"86ada943-10c1-4872-85f2-1295a2e95aeb\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xz75p" Jul 30 13:05:33.181702 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:33.181610 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8t7vk\" (UniqueName: \"kubernetes.io/projected/86ada943-10c1-4872-85f2-1295a2e95aeb-kube-api-access-8t7vk\") pod \"istiod-openshift-gateway-5677ccb49b-xz75p\" (UID: \"86ada943-10c1-4872-85f2-1295a2e95aeb\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xz75p" Jul 30 13:05:33.181702 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:33.181636 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/86ada943-10c1-4872-85f2-1295a2e95aeb-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-xz75p\" (UID: \"86ada943-10c1-4872-85f2-1295a2e95aeb\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xz75p" Jul 30 13:05:33.181702 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:33.181681 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/86ada943-10c1-4872-85f2-1295a2e95aeb-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-xz75p\" (UID: \"86ada943-10c1-4872-85f2-1295a2e95aeb\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xz75p" Jul 30 13:05:33.182023 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:33.181717 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/86ada943-10c1-4872-85f2-1295a2e95aeb-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-xz75p\" (UID: \"86ada943-10c1-4872-85f2-1295a2e95aeb\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xz75p" Jul 30 13:05:33.182884 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:33.182852 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/86ada943-10c1-4872-85f2-1295a2e95aeb-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-xz75p\" (UID: \"86ada943-10c1-4872-85f2-1295a2e95aeb\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xz75p" Jul 30 13:05:33.183002 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:33.182903 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-cch52"] Jul 30 13:05:33.184344 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:33.184312 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/86ada943-10c1-4872-85f2-1295a2e95aeb-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-xz75p\" (UID: \"86ada943-10c1-4872-85f2-1295a2e95aeb\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xz75p" Jul 30 13:05:33.184344 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:33.184328 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/86ada943-10c1-4872-85f2-1295a2e95aeb-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-xz75p\" (UID: \"86ada943-10c1-4872-85f2-1295a2e95aeb\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xz75p" Jul 30 13:05:33.184501 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:33.184314 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/86ada943-10c1-4872-85f2-1295a2e95aeb-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-xz75p\" (UID: \"86ada943-10c1-4872-85f2-1295a2e95aeb\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xz75p" Jul 30 13:05:33.184501 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:33.184457 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/86ada943-10c1-4872-85f2-1295a2e95aeb-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-xz75p\" (UID: \"86ada943-10c1-4872-85f2-1295a2e95aeb\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xz75p" Jul 30 13:05:33.184840 ip-10-0-133-230 kubenswrapper[2579]: W0730 13:05:33.184814 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded205912_55a1_484b_bf85_f76d5ceadfc7.slice/crio-84f2f57b25aa237522a8496f820d146add258f90971719a4c362175a55c76b34 WatchSource:0}: Error finding container 84f2f57b25aa237522a8496f820d146add258f90971719a4c362175a55c76b34: Status 404 returned error can't find the container with id 84f2f57b25aa237522a8496f820d146add258f90971719a4c362175a55c76b34 Jul 30 13:05:33.189184 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:33.189156 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:05:33.191060 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:33.191040 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8t7vk\" (UniqueName: \"kubernetes.io/projected/86ada943-10c1-4872-85f2-1295a2e95aeb-kube-api-access-8t7vk\") pod \"istiod-openshift-gateway-5677ccb49b-xz75p\" (UID: \"86ada943-10c1-4872-85f2-1295a2e95aeb\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xz75p" Jul 30 13:05:33.191311 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:33.191294 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/86ada943-10c1-4872-85f2-1295a2e95aeb-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-xz75p\" (UID: \"86ada943-10c1-4872-85f2-1295a2e95aeb\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xz75p" Jul 30 13:05:33.268911 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:33.268834 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xz75p" Jul 30 13:05:33.439216 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:33.439191 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-xz75p"] Jul 30 13:05:33.440916 ip-10-0-133-230 kubenswrapper[2579]: W0730 13:05:33.440894 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86ada943_10c1_4872_85f2_1295a2e95aeb.slice/crio-03d2fd6c87df4acbec7b3be9b25961f6b27ab0e0480901d15ff18d5034b45cc2 WatchSource:0}: Error finding container 03d2fd6c87df4acbec7b3be9b25961f6b27ab0e0480901d15ff18d5034b45cc2: Status 404 returned error can't find the container with id 03d2fd6c87df4acbec7b3be9b25961f6b27ab0e0480901d15ff18d5034b45cc2 Jul 30 13:05:33.450473 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:33.450445 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-cch52" event={"ID":"ed205912-55a1-484b-bf85-f76d5ceadfc7","Type":"ContainerStarted","Data":"84f2f57b25aa237522a8496f820d146add258f90971719a4c362175a55c76b34"} Jul 30 13:05:33.451721 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:33.451694 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xz75p" event={"ID":"86ada943-10c1-4872-85f2-1295a2e95aeb","Type":"ContainerStarted","Data":"03d2fd6c87df4acbec7b3be9b25961f6b27ab0e0480901d15ff18d5034b45cc2"} Jul 30 13:05:35.415589 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:35.415559 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-d8f5f8447-9kzh9" Jul 30 13:05:36.002988 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:36.002945 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:05:36.046216 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:36.046161 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 30 13:05:36.046378 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:36.046255 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 30 13:05:36.046378 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:36.046301 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 30 13:05:36.141282 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:36.141234 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:05:36.259139 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:36.259048 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:05:36.469876 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:36.469838 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-cch52" event={"ID":"ed205912-55a1-484b-bf85-f76d5ceadfc7","Type":"ContainerStarted","Data":"42c5309184a1f9dfa9f3aa359123650bca5319920c0e2c91109367ba4d3fdf36"} Jul 30 13:05:36.495547 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:36.495494 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-cch52" podStartSLOduration=1.636389575 podStartE2EDuration="4.495476988s" totalImagesPullingTime="2.859087413s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:05:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:05:36.492684719 +0000 UTC m=+384.324150844" watchObservedRunningTime="2026-07-30 13:05:36.495476988 +0000 UTC m=+384.326943112" Jul 30 13:05:36.850965 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:36.850924 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:05:37.044743 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:37.044704 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-cch52" Jul 30 13:05:37.051687 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:37.051647 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-cch52" Jul 30 13:05:37.284262 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:37.284225 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:05:37.381902 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:37.381866 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:05:37.474371 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:37.474341 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-cch52" Jul 30 13:05:37.475471 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:37.475451 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-cch52" Jul 30 13:05:37.492432 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:37.492391 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:05:38.091549 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:38.091508 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:05:38.157769 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:38.157737 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:05:44.830365 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:44.830321 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 30 13:05:44.830824 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:44.830404 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 30 13:05:45.517474 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:45.517434 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xz75p" event={"ID":"86ada943-10c1-4872-85f2-1295a2e95aeb","Type":"ContainerStarted","Data":"446095b05f682de6c32c7e33340b72fcb7937b60d0315cb9a39353d493fcdf21"} Jul 30 13:05:45.517672 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:45.517590 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xz75p" Jul 30 13:05:45.519195 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:45.519164 2579 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-xz75p container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 30 13:05:45.519326 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:45.519251 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xz75p" podUID="86ada943-10c1-4872-85f2-1295a2e95aeb" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 30 13:05:45.542861 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:45.542811 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xz75p" podStartSLOduration=2.155545603 podStartE2EDuration="13.542796537s" totalImagesPullingTime="11.387250934s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:05:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:05:45.540974171 +0000 UTC m=+393.372440297" watchObservedRunningTime="2026-07-30 13:05:45.542796537 +0000 UTC m=+393.374262661" Jul 30 13:05:46.522530 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:05:46.522497 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xz75p" Jul 30 13:06:05.404365 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:05.404326 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:06:08.317693 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:08.317654 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:06:08.383486 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:08.383450 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:06:26.292054 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:26.292023 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:06:26.403029 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:26.402976 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:06:26.618805 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:26.618683 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:06:41.397013 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:41.396937 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2h7r"] Jul 30 13:06:41.400467 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:41.400449 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2h7r" Jul 30 13:06:41.403090 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:41.403064 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c46530cc-1c2f-47f1-9889-abbd30f314f8-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2h7r\" (UID: \"c46530cc-1c2f-47f1-9889-abbd30f314f8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2h7r" Jul 30 13:06:41.403237 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:41.403148 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c46530cc-1c2f-47f1-9889-abbd30f314f8-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2h7r\" (UID: \"c46530cc-1c2f-47f1-9889-abbd30f314f8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2h7r" Jul 30 13:06:41.403237 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:41.403221 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cv45p\" (UniqueName: \"kubernetes.io/projected/c46530cc-1c2f-47f1-9889-abbd30f314f8-kube-api-access-cv45p\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2h7r\" (UID: \"c46530cc-1c2f-47f1-9889-abbd30f314f8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2h7r" Jul 30 13:06:41.403349 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:41.403332 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 30 13:06:41.404277 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:41.404261 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 30 13:06:41.404867 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:41.404846 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-q85h5\"" Jul 30 13:06:41.411263 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:41.411237 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2h7r"] Jul 30 13:06:41.504092 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:41.504059 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cv45p\" (UniqueName: \"kubernetes.io/projected/c46530cc-1c2f-47f1-9889-abbd30f314f8-kube-api-access-cv45p\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2h7r\" (UID: \"c46530cc-1c2f-47f1-9889-abbd30f314f8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2h7r" Jul 30 13:06:41.504291 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:41.504133 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c46530cc-1c2f-47f1-9889-abbd30f314f8-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2h7r\" (UID: \"c46530cc-1c2f-47f1-9889-abbd30f314f8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2h7r" Jul 30 13:06:41.504291 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:41.504175 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c46530cc-1c2f-47f1-9889-abbd30f314f8-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2h7r\" (UID: \"c46530cc-1c2f-47f1-9889-abbd30f314f8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2h7r" Jul 30 13:06:41.504611 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:41.504589 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c46530cc-1c2f-47f1-9889-abbd30f314f8-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2h7r\" (UID: \"c46530cc-1c2f-47f1-9889-abbd30f314f8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2h7r" Jul 30 13:06:41.504686 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:41.504609 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c46530cc-1c2f-47f1-9889-abbd30f314f8-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2h7r\" (UID: \"c46530cc-1c2f-47f1-9889-abbd30f314f8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2h7r" Jul 30 13:06:41.514086 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:41.514068 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cv45p\" (UniqueName: \"kubernetes.io/projected/c46530cc-1c2f-47f1-9889-abbd30f314f8-kube-api-access-cv45p\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2h7r\" (UID: \"c46530cc-1c2f-47f1-9889-abbd30f314f8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2h7r" Jul 30 13:06:41.710282 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:41.710246 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2h7r" Jul 30 13:06:41.842827 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:41.842795 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2h7r"] Jul 30 13:06:41.846793 ip-10-0-133-230 kubenswrapper[2579]: W0730 13:06:41.846765 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc46530cc_1c2f_47f1_9889_abbd30f314f8.slice/crio-7fc43d32bde924191efdd7225fbdb4b0f01ff34fc535edf2bb6794f9be6be64b WatchSource:0}: Error finding container 7fc43d32bde924191efdd7225fbdb4b0f01ff34fc535edf2bb6794f9be6be64b: Status 404 returned error can't find the container with id 7fc43d32bde924191efdd7225fbdb4b0f01ff34fc535edf2bb6794f9be6be64b Jul 30 13:06:42.008454 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:42.008373 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599l7j4"] Jul 30 13:06:42.011885 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:42.011870 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599l7j4" Jul 30 13:06:42.025707 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:42.025684 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599l7j4"] Jul 30 13:06:42.108050 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:42.108020 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/919dcf41-659d-4a1a-bd60-02bacc954f13-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599l7j4\" (UID: \"919dcf41-659d-4a1a-bd60-02bacc954f13\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599l7j4" Jul 30 13:06:42.108218 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:42.108068 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/919dcf41-659d-4a1a-bd60-02bacc954f13-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599l7j4\" (UID: \"919dcf41-659d-4a1a-bd60-02bacc954f13\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599l7j4" Jul 30 13:06:42.108218 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:42.108203 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpbfz\" (UniqueName: \"kubernetes.io/projected/919dcf41-659d-4a1a-bd60-02bacc954f13-kube-api-access-hpbfz\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599l7j4\" (UID: \"919dcf41-659d-4a1a-bd60-02bacc954f13\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599l7j4" Jul 30 13:06:42.209079 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:42.209039 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpbfz\" (UniqueName: \"kubernetes.io/projected/919dcf41-659d-4a1a-bd60-02bacc954f13-kube-api-access-hpbfz\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599l7j4\" (UID: \"919dcf41-659d-4a1a-bd60-02bacc954f13\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599l7j4" Jul 30 13:06:42.209284 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:42.209105 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/919dcf41-659d-4a1a-bd60-02bacc954f13-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599l7j4\" (UID: \"919dcf41-659d-4a1a-bd60-02bacc954f13\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599l7j4" Jul 30 13:06:42.209284 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:42.209148 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/919dcf41-659d-4a1a-bd60-02bacc954f13-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599l7j4\" (UID: \"919dcf41-659d-4a1a-bd60-02bacc954f13\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599l7j4" Jul 30 13:06:42.209540 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:42.209517 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/919dcf41-659d-4a1a-bd60-02bacc954f13-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599l7j4\" (UID: \"919dcf41-659d-4a1a-bd60-02bacc954f13\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599l7j4" Jul 30 13:06:42.209622 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:42.209583 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/919dcf41-659d-4a1a-bd60-02bacc954f13-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599l7j4\" (UID: \"919dcf41-659d-4a1a-bd60-02bacc954f13\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599l7j4" Jul 30 13:06:42.218058 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:42.218031 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpbfz\" (UniqueName: \"kubernetes.io/projected/919dcf41-659d-4a1a-bd60-02bacc954f13-kube-api-access-hpbfz\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599l7j4\" (UID: \"919dcf41-659d-4a1a-bd60-02bacc954f13\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599l7j4" Jul 30 13:06:42.320514 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:42.320385 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599l7j4" Jul 30 13:06:42.448732 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:42.448704 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599l7j4"] Jul 30 13:06:42.450669 ip-10-0-133-230 kubenswrapper[2579]: W0730 13:06:42.450636 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod919dcf41_659d_4a1a_bd60_02bacc954f13.slice/crio-b28c90676a5d713c2e8167a2e4ae1e1d4858f3f7c57376f0825c4e81d7aa1d82 WatchSource:0}: Error finding container b28c90676a5d713c2e8167a2e4ae1e1d4858f3f7c57376f0825c4e81d7aa1d82: Status 404 returned error can't find the container with id b28c90676a5d713c2e8167a2e4ae1e1d4858f3f7c57376f0825c4e81d7aa1d82 Jul 30 13:06:42.609767 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:42.609688 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g956q"] Jul 30 13:06:42.613120 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:42.613103 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g956q" Jul 30 13:06:42.622257 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:42.622227 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g956q"] Jul 30 13:06:42.711765 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:42.711737 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/469070c9-6c31-445c-8795-55e304582f6e-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g956q\" (UID: \"469070c9-6c31-445c-8795-55e304582f6e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g956q" Jul 30 13:06:42.712013 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:42.711775 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4x9s\" (UniqueName: \"kubernetes.io/projected/469070c9-6c31-445c-8795-55e304582f6e-kube-api-access-s4x9s\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g956q\" (UID: \"469070c9-6c31-445c-8795-55e304582f6e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g956q" Jul 30 13:06:42.712013 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:42.711913 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/469070c9-6c31-445c-8795-55e304582f6e-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g956q\" (UID: \"469070c9-6c31-445c-8795-55e304582f6e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g956q" Jul 30 13:06:42.789097 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:42.789062 2579 generic.go:356] "Generic (PLEG): container finished" podID="c46530cc-1c2f-47f1-9889-abbd30f314f8" containerID="74bfcb572826ae0c81ab0068041b30b16c5b4221f63c2b47d8ab12479208503e" exitCode=0 Jul 30 13:06:42.789281 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:42.789152 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2h7r" event={"ID":"c46530cc-1c2f-47f1-9889-abbd30f314f8","Type":"ContainerDied","Data":"74bfcb572826ae0c81ab0068041b30b16c5b4221f63c2b47d8ab12479208503e"} Jul 30 13:06:42.789281 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:42.789202 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2h7r" event={"ID":"c46530cc-1c2f-47f1-9889-abbd30f314f8","Type":"ContainerStarted","Data":"7fc43d32bde924191efdd7225fbdb4b0f01ff34fc535edf2bb6794f9be6be64b"} Jul 30 13:06:42.790668 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:42.790639 2579 generic.go:356] "Generic (PLEG): container finished" podID="919dcf41-659d-4a1a-bd60-02bacc954f13" containerID="b36381f1149c25d5510d0dcc8270b8732edfa006668782ecb01bfcf76338178d" exitCode=0 Jul 30 13:06:42.790781 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:42.790728 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599l7j4" event={"ID":"919dcf41-659d-4a1a-bd60-02bacc954f13","Type":"ContainerDied","Data":"b36381f1149c25d5510d0dcc8270b8732edfa006668782ecb01bfcf76338178d"} Jul 30 13:06:42.790781 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:42.790769 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599l7j4" event={"ID":"919dcf41-659d-4a1a-bd60-02bacc954f13","Type":"ContainerStarted","Data":"b28c90676a5d713c2e8167a2e4ae1e1d4858f3f7c57376f0825c4e81d7aa1d82"} Jul 30 13:06:42.812815 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:42.812790 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/469070c9-6c31-445c-8795-55e304582f6e-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g956q\" (UID: \"469070c9-6c31-445c-8795-55e304582f6e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g956q" Jul 30 13:06:42.812958 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:42.812860 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/469070c9-6c31-445c-8795-55e304582f6e-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g956q\" (UID: \"469070c9-6c31-445c-8795-55e304582f6e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g956q" Jul 30 13:06:42.812958 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:42.812895 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4x9s\" (UniqueName: \"kubernetes.io/projected/469070c9-6c31-445c-8795-55e304582f6e-kube-api-access-s4x9s\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g956q\" (UID: \"469070c9-6c31-445c-8795-55e304582f6e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g956q" Jul 30 13:06:42.813180 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:42.813160 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/469070c9-6c31-445c-8795-55e304582f6e-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g956q\" (UID: \"469070c9-6c31-445c-8795-55e304582f6e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g956q" Jul 30 13:06:42.813257 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:42.813239 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/469070c9-6c31-445c-8795-55e304582f6e-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g956q\" (UID: \"469070c9-6c31-445c-8795-55e304582f6e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g956q" Jul 30 13:06:42.822589 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:42.822564 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4x9s\" (UniqueName: \"kubernetes.io/projected/469070c9-6c31-445c-8795-55e304582f6e-kube-api-access-s4x9s\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g956q\" (UID: \"469070c9-6c31-445c-8795-55e304582f6e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g956q" Jul 30 13:06:42.923389 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:42.923289 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g956q" Jul 30 13:06:42.998055 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:42.998017 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kkgzg"] Jul 30 13:06:43.001879 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:43.001858 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kkgzg" Jul 30 13:06:43.016483 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:43.016442 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmpjd\" (UniqueName: \"kubernetes.io/projected/9f64c58c-5a9c-446d-8e97-0893e17b4961-kube-api-access-jmpjd\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kkgzg\" (UID: \"9f64c58c-5a9c-446d-8e97-0893e17b4961\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kkgzg" Jul 30 13:06:43.016625 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:43.016516 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f64c58c-5a9c-446d-8e97-0893e17b4961-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kkgzg\" (UID: \"9f64c58c-5a9c-446d-8e97-0893e17b4961\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kkgzg" Jul 30 13:06:43.016625 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:43.016604 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f64c58c-5a9c-446d-8e97-0893e17b4961-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kkgzg\" (UID: \"9f64c58c-5a9c-446d-8e97-0893e17b4961\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kkgzg" Jul 30 13:06:43.017379 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:43.017356 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kkgzg"] Jul 30 13:06:43.061161 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:43.061131 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g956q"] Jul 30 13:06:43.064753 ip-10-0-133-230 kubenswrapper[2579]: W0730 13:06:43.064720 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod469070c9_6c31_445c_8795_55e304582f6e.slice/crio-f588c2fd6bf19af3a43d8de7d55cf5ea6f61a6ebe962c8f8d177ec27c3294f1b WatchSource:0}: Error finding container f588c2fd6bf19af3a43d8de7d55cf5ea6f61a6ebe962c8f8d177ec27c3294f1b: Status 404 returned error can't find the container with id f588c2fd6bf19af3a43d8de7d55cf5ea6f61a6ebe962c8f8d177ec27c3294f1b Jul 30 13:06:43.117832 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:43.117808 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f64c58c-5a9c-446d-8e97-0893e17b4961-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kkgzg\" (UID: \"9f64c58c-5a9c-446d-8e97-0893e17b4961\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kkgzg" Jul 30 13:06:43.117900 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:43.117886 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f64c58c-5a9c-446d-8e97-0893e17b4961-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kkgzg\" (UID: \"9f64c58c-5a9c-446d-8e97-0893e17b4961\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kkgzg" Jul 30 13:06:43.117982 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:43.117966 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmpjd\" (UniqueName: \"kubernetes.io/projected/9f64c58c-5a9c-446d-8e97-0893e17b4961-kube-api-access-jmpjd\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kkgzg\" (UID: \"9f64c58c-5a9c-446d-8e97-0893e17b4961\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kkgzg" Jul 30 13:06:43.118214 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:43.118194 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f64c58c-5a9c-446d-8e97-0893e17b4961-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kkgzg\" (UID: \"9f64c58c-5a9c-446d-8e97-0893e17b4961\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kkgzg" Jul 30 13:06:43.118317 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:43.118245 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f64c58c-5a9c-446d-8e97-0893e17b4961-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kkgzg\" (UID: \"9f64c58c-5a9c-446d-8e97-0893e17b4961\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kkgzg" Jul 30 13:06:43.128432 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:43.128397 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmpjd\" (UniqueName: \"kubernetes.io/projected/9f64c58c-5a9c-446d-8e97-0893e17b4961-kube-api-access-jmpjd\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kkgzg\" (UID: \"9f64c58c-5a9c-446d-8e97-0893e17b4961\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kkgzg" Jul 30 13:06:43.313592 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:43.313555 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kkgzg" Jul 30 13:06:43.449187 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:43.449160 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kkgzg"] Jul 30 13:06:43.508775 ip-10-0-133-230 kubenswrapper[2579]: W0730 13:06:43.508740 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f64c58c_5a9c_446d_8e97_0893e17b4961.slice/crio-bb4046249344bb8a95009632537e6bf5b11e5db35047e80b10efc5cbd20dfaba WatchSource:0}: Error finding container bb4046249344bb8a95009632537e6bf5b11e5db35047e80b10efc5cbd20dfaba: Status 404 returned error can't find the container with id bb4046249344bb8a95009632537e6bf5b11e5db35047e80b10efc5cbd20dfaba Jul 30 13:06:43.753233 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:06:43.753206 2579 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod919dcf41_659d_4a1a_bd60_02bacc954f13.slice/crio-bf9d9eae793461903ca2a34b9c27b2c07332fc0c71f452e252d801596ae4425a.scope\": RecentStats: unable to find data in memory cache]" Jul 30 13:06:43.797714 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:43.797687 2579 generic.go:356] "Generic (PLEG): container finished" podID="c46530cc-1c2f-47f1-9889-abbd30f314f8" containerID="9d913bb79e7d577c55f68351825c52b9dad4a782f887a6ac1d443b1872233dde" exitCode=0 Jul 30 13:06:43.797832 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:43.797765 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2h7r" event={"ID":"c46530cc-1c2f-47f1-9889-abbd30f314f8","Type":"ContainerDied","Data":"9d913bb79e7d577c55f68351825c52b9dad4a782f887a6ac1d443b1872233dde"} Jul 30 13:06:43.799342 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:43.799250 2579 generic.go:356] "Generic (PLEG): container finished" podID="9f64c58c-5a9c-446d-8e97-0893e17b4961" containerID="f8cfc8af7f4fab0cec33cac1dc0c69f0200fd7dfba6ffb702d20e398d6374191" exitCode=0 Jul 30 13:06:43.799454 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:43.799337 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kkgzg" event={"ID":"9f64c58c-5a9c-446d-8e97-0893e17b4961","Type":"ContainerDied","Data":"f8cfc8af7f4fab0cec33cac1dc0c69f0200fd7dfba6ffb702d20e398d6374191"} Jul 30 13:06:43.799454 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:43.799384 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kkgzg" event={"ID":"9f64c58c-5a9c-446d-8e97-0893e17b4961","Type":"ContainerStarted","Data":"bb4046249344bb8a95009632537e6bf5b11e5db35047e80b10efc5cbd20dfaba"} Jul 30 13:06:43.801278 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:43.801256 2579 generic.go:356] "Generic (PLEG): container finished" podID="919dcf41-659d-4a1a-bd60-02bacc954f13" containerID="bf9d9eae793461903ca2a34b9c27b2c07332fc0c71f452e252d801596ae4425a" exitCode=0 Jul 30 13:06:43.801378 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:43.801334 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599l7j4" event={"ID":"919dcf41-659d-4a1a-bd60-02bacc954f13","Type":"ContainerDied","Data":"bf9d9eae793461903ca2a34b9c27b2c07332fc0c71f452e252d801596ae4425a"} Jul 30 13:06:43.803113 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:43.803074 2579 generic.go:356] "Generic (PLEG): container finished" podID="469070c9-6c31-445c-8795-55e304582f6e" containerID="1253ae742ee11c892342a8ad85ac680fbc028a9f2ad6ab48bb390bd9617f40c3" exitCode=0 Jul 30 13:06:43.803172 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:43.803153 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g956q" event={"ID":"469070c9-6c31-445c-8795-55e304582f6e","Type":"ContainerDied","Data":"1253ae742ee11c892342a8ad85ac680fbc028a9f2ad6ab48bb390bd9617f40c3"} Jul 30 13:06:43.803209 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:43.803192 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g956q" event={"ID":"469070c9-6c31-445c-8795-55e304582f6e","Type":"ContainerStarted","Data":"f588c2fd6bf19af3a43d8de7d55cf5ea6f61a6ebe962c8f8d177ec27c3294f1b"} Jul 30 13:06:44.811699 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:44.811664 2579 generic.go:356] "Generic (PLEG): container finished" podID="c46530cc-1c2f-47f1-9889-abbd30f314f8" containerID="f74137b7e144e726ed6bb05696e37f1fc88acbe5d8dee14eb69cb819ae2094c0" exitCode=0 Jul 30 13:06:44.812275 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:44.811761 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2h7r" event={"ID":"c46530cc-1c2f-47f1-9889-abbd30f314f8","Type":"ContainerDied","Data":"f74137b7e144e726ed6bb05696e37f1fc88acbe5d8dee14eb69cb819ae2094c0"} Jul 30 13:06:44.813934 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:44.813909 2579 generic.go:356] "Generic (PLEG): container finished" podID="919dcf41-659d-4a1a-bd60-02bacc954f13" containerID="64932d36d34a9742bf5c38ed76d08274fe5244cbaa54425c5d93f21a714d208f" exitCode=0 Jul 30 13:06:44.814066 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:44.813981 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599l7j4" event={"ID":"919dcf41-659d-4a1a-bd60-02bacc954f13","Type":"ContainerDied","Data":"64932d36d34a9742bf5c38ed76d08274fe5244cbaa54425c5d93f21a714d208f"} Jul 30 13:06:44.816022 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:44.815995 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g956q" event={"ID":"469070c9-6c31-445c-8795-55e304582f6e","Type":"ContainerStarted","Data":"20e1a9975b86b1e5f8cbe5526f125f0b83682cb9e8aeb13dde0bff8b94fdd69d"} Jul 30 13:06:45.823028 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:45.822992 2579 generic.go:356] "Generic (PLEG): container finished" podID="9f64c58c-5a9c-446d-8e97-0893e17b4961" containerID="88588eb8c1fe7ae2b22d48791c0050ffedce0630ed24bdbe6031e832f0fa071e" exitCode=0 Jul 30 13:06:45.823503 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:45.823081 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kkgzg" event={"ID":"9f64c58c-5a9c-446d-8e97-0893e17b4961","Type":"ContainerDied","Data":"88588eb8c1fe7ae2b22d48791c0050ffedce0630ed24bdbe6031e832f0fa071e"} Jul 30 13:06:45.824852 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:45.824831 2579 generic.go:356] "Generic (PLEG): container finished" podID="469070c9-6c31-445c-8795-55e304582f6e" containerID="20e1a9975b86b1e5f8cbe5526f125f0b83682cb9e8aeb13dde0bff8b94fdd69d" exitCode=0 Jul 30 13:06:45.824954 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:45.824931 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g956q" event={"ID":"469070c9-6c31-445c-8795-55e304582f6e","Type":"ContainerDied","Data":"20e1a9975b86b1e5f8cbe5526f125f0b83682cb9e8aeb13dde0bff8b94fdd69d"} Jul 30 13:06:45.980686 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:45.980656 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599l7j4" Jul 30 13:06:46.042224 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:46.042193 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/919dcf41-659d-4a1a-bd60-02bacc954f13-bundle\") pod \"919dcf41-659d-4a1a-bd60-02bacc954f13\" (UID: \"919dcf41-659d-4a1a-bd60-02bacc954f13\") " Jul 30 13:06:46.042536 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:46.042252 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hpbfz\" (UniqueName: \"kubernetes.io/projected/919dcf41-659d-4a1a-bd60-02bacc954f13-kube-api-access-hpbfz\") pod \"919dcf41-659d-4a1a-bd60-02bacc954f13\" (UID: \"919dcf41-659d-4a1a-bd60-02bacc954f13\") " Jul 30 13:06:46.042536 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:46.042331 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/919dcf41-659d-4a1a-bd60-02bacc954f13-util\") pod \"919dcf41-659d-4a1a-bd60-02bacc954f13\" (UID: \"919dcf41-659d-4a1a-bd60-02bacc954f13\") " Jul 30 13:06:46.042827 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:46.042802 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/919dcf41-659d-4a1a-bd60-02bacc954f13-bundle" (OuterVolumeSpecName: "bundle") pod "919dcf41-659d-4a1a-bd60-02bacc954f13" (UID: "919dcf41-659d-4a1a-bd60-02bacc954f13"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 13:06:46.044506 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:46.044475 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/919dcf41-659d-4a1a-bd60-02bacc954f13-kube-api-access-hpbfz" (OuterVolumeSpecName: "kube-api-access-hpbfz") pod "919dcf41-659d-4a1a-bd60-02bacc954f13" (UID: "919dcf41-659d-4a1a-bd60-02bacc954f13"). InnerVolumeSpecName "kube-api-access-hpbfz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 13:06:46.047931 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:46.047909 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/919dcf41-659d-4a1a-bd60-02bacc954f13-util" (OuterVolumeSpecName: "util") pod "919dcf41-659d-4a1a-bd60-02bacc954f13" (UID: "919dcf41-659d-4a1a-bd60-02bacc954f13"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 13:06:46.106548 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:46.106486 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2h7r" Jul 30 13:06:46.143259 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:46.143231 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c46530cc-1c2f-47f1-9889-abbd30f314f8-util\") pod \"c46530cc-1c2f-47f1-9889-abbd30f314f8\" (UID: \"c46530cc-1c2f-47f1-9889-abbd30f314f8\") " Jul 30 13:06:46.143456 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:46.143269 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cv45p\" (UniqueName: \"kubernetes.io/projected/c46530cc-1c2f-47f1-9889-abbd30f314f8-kube-api-access-cv45p\") pod \"c46530cc-1c2f-47f1-9889-abbd30f314f8\" (UID: \"c46530cc-1c2f-47f1-9889-abbd30f314f8\") " Jul 30 13:06:46.143456 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:46.143306 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c46530cc-1c2f-47f1-9889-abbd30f314f8-bundle\") pod \"c46530cc-1c2f-47f1-9889-abbd30f314f8\" (UID: \"c46530cc-1c2f-47f1-9889-abbd30f314f8\") " Jul 30 13:06:46.143598 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:46.143506 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/919dcf41-659d-4a1a-bd60-02bacc954f13-bundle\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 13:06:46.143598 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:46.143517 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hpbfz\" (UniqueName: \"kubernetes.io/projected/919dcf41-659d-4a1a-bd60-02bacc954f13-kube-api-access-hpbfz\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 13:06:46.143598 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:46.143526 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/919dcf41-659d-4a1a-bd60-02bacc954f13-util\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 13:06:46.143845 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:46.143818 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c46530cc-1c2f-47f1-9889-abbd30f314f8-bundle" (OuterVolumeSpecName: "bundle") pod "c46530cc-1c2f-47f1-9889-abbd30f314f8" (UID: "c46530cc-1c2f-47f1-9889-abbd30f314f8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 13:06:46.145921 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:46.145857 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c46530cc-1c2f-47f1-9889-abbd30f314f8-kube-api-access-cv45p" (OuterVolumeSpecName: "kube-api-access-cv45p") pod "c46530cc-1c2f-47f1-9889-abbd30f314f8" (UID: "c46530cc-1c2f-47f1-9889-abbd30f314f8"). InnerVolumeSpecName "kube-api-access-cv45p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 13:06:46.149868 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:46.149826 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c46530cc-1c2f-47f1-9889-abbd30f314f8-util" (OuterVolumeSpecName: "util") pod "c46530cc-1c2f-47f1-9889-abbd30f314f8" (UID: "c46530cc-1c2f-47f1-9889-abbd30f314f8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 13:06:46.244581 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:46.244540 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c46530cc-1c2f-47f1-9889-abbd30f314f8-bundle\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 13:06:46.244581 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:46.244572 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c46530cc-1c2f-47f1-9889-abbd30f314f8-util\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 13:06:46.244581 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:46.244585 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cv45p\" (UniqueName: \"kubernetes.io/projected/c46530cc-1c2f-47f1-9889-abbd30f314f8-kube-api-access-cv45p\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 13:06:46.832659 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:46.832628 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2h7r" event={"ID":"c46530cc-1c2f-47f1-9889-abbd30f314f8","Type":"ContainerDied","Data":"7fc43d32bde924191efdd7225fbdb4b0f01ff34fc535edf2bb6794f9be6be64b"} Jul 30 13:06:46.833035 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:46.832684 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7fc43d32bde924191efdd7225fbdb4b0f01ff34fc535edf2bb6794f9be6be64b" Jul 30 13:06:46.833035 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:46.832635 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2h7r" Jul 30 13:06:46.834946 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:46.834887 2579 generic.go:356] "Generic (PLEG): container finished" podID="9f64c58c-5a9c-446d-8e97-0893e17b4961" containerID="92580a75dddd27869113ac76da5a9648aad924edc335714b16e2290123246248" exitCode=0 Jul 30 13:06:46.834946 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:46.834929 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kkgzg" event={"ID":"9f64c58c-5a9c-446d-8e97-0893e17b4961","Type":"ContainerDied","Data":"92580a75dddd27869113ac76da5a9648aad924edc335714b16e2290123246248"} Jul 30 13:06:46.836818 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:46.836787 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599l7j4" event={"ID":"919dcf41-659d-4a1a-bd60-02bacc954f13","Type":"ContainerDied","Data":"b28c90676a5d713c2e8167a2e4ae1e1d4858f3f7c57376f0825c4e81d7aa1d82"} Jul 30 13:06:46.836818 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:46.836818 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b28c90676a5d713c2e8167a2e4ae1e1d4858f3f7c57376f0825c4e81d7aa1d82" Jul 30 13:06:46.836979 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:46.836790 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599l7j4" Jul 30 13:06:46.839032 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:46.839006 2579 generic.go:356] "Generic (PLEG): container finished" podID="469070c9-6c31-445c-8795-55e304582f6e" containerID="2afa9a2ce31533a15b3ea4970f8076941aaccfa05232ecb3fc3ee89344b7e0c8" exitCode=0 Jul 30 13:06:46.839140 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:46.839089 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g956q" event={"ID":"469070c9-6c31-445c-8795-55e304582f6e","Type":"ContainerDied","Data":"2afa9a2ce31533a15b3ea4970f8076941aaccfa05232ecb3fc3ee89344b7e0c8"} Jul 30 13:06:47.981286 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:47.981258 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g956q" Jul 30 13:06:48.011423 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:48.011386 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kkgzg" Jul 30 13:06:48.060986 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:48.060958 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s4x9s\" (UniqueName: \"kubernetes.io/projected/469070c9-6c31-445c-8795-55e304582f6e-kube-api-access-s4x9s\") pod \"469070c9-6c31-445c-8795-55e304582f6e\" (UID: \"469070c9-6c31-445c-8795-55e304582f6e\") " Jul 30 13:06:48.061146 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:48.060997 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jmpjd\" (UniqueName: \"kubernetes.io/projected/9f64c58c-5a9c-446d-8e97-0893e17b4961-kube-api-access-jmpjd\") pod \"9f64c58c-5a9c-446d-8e97-0893e17b4961\" (UID: \"9f64c58c-5a9c-446d-8e97-0893e17b4961\") " Jul 30 13:06:48.061146 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:48.061047 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/469070c9-6c31-445c-8795-55e304582f6e-bundle\") pod \"469070c9-6c31-445c-8795-55e304582f6e\" (UID: \"469070c9-6c31-445c-8795-55e304582f6e\") " Jul 30 13:06:48.061146 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:48.061080 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/469070c9-6c31-445c-8795-55e304582f6e-util\") pod \"469070c9-6c31-445c-8795-55e304582f6e\" (UID: \"469070c9-6c31-445c-8795-55e304582f6e\") " Jul 30 13:06:48.061146 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:48.061103 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f64c58c-5a9c-446d-8e97-0893e17b4961-util\") pod \"9f64c58c-5a9c-446d-8e97-0893e17b4961\" (UID: \"9f64c58c-5a9c-446d-8e97-0893e17b4961\") " Jul 30 13:06:48.061146 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:48.061120 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f64c58c-5a9c-446d-8e97-0893e17b4961-bundle\") pod \"9f64c58c-5a9c-446d-8e97-0893e17b4961\" (UID: \"9f64c58c-5a9c-446d-8e97-0893e17b4961\") " Jul 30 13:06:48.061843 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:48.061811 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/469070c9-6c31-445c-8795-55e304582f6e-bundle" (OuterVolumeSpecName: "bundle") pod "469070c9-6c31-445c-8795-55e304582f6e" (UID: "469070c9-6c31-445c-8795-55e304582f6e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 13:06:48.061977 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:48.061814 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f64c58c-5a9c-446d-8e97-0893e17b4961-bundle" (OuterVolumeSpecName: "bundle") pod "9f64c58c-5a9c-446d-8e97-0893e17b4961" (UID: "9f64c58c-5a9c-446d-8e97-0893e17b4961"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 13:06:48.063252 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:48.063220 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/469070c9-6c31-445c-8795-55e304582f6e-kube-api-access-s4x9s" (OuterVolumeSpecName: "kube-api-access-s4x9s") pod "469070c9-6c31-445c-8795-55e304582f6e" (UID: "469070c9-6c31-445c-8795-55e304582f6e"). InnerVolumeSpecName "kube-api-access-s4x9s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 13:06:48.063339 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:48.063252 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f64c58c-5a9c-446d-8e97-0893e17b4961-kube-api-access-jmpjd" (OuterVolumeSpecName: "kube-api-access-jmpjd") pod "9f64c58c-5a9c-446d-8e97-0893e17b4961" (UID: "9f64c58c-5a9c-446d-8e97-0893e17b4961"). InnerVolumeSpecName "kube-api-access-jmpjd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 13:06:48.066842 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:48.066805 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/469070c9-6c31-445c-8795-55e304582f6e-util" (OuterVolumeSpecName: "util") pod "469070c9-6c31-445c-8795-55e304582f6e" (UID: "469070c9-6c31-445c-8795-55e304582f6e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 13:06:48.069078 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:48.069055 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f64c58c-5a9c-446d-8e97-0893e17b4961-util" (OuterVolumeSpecName: "util") pod "9f64c58c-5a9c-446d-8e97-0893e17b4961" (UID: "9f64c58c-5a9c-446d-8e97-0893e17b4961"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 13:06:48.162133 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:48.162061 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s4x9s\" (UniqueName: \"kubernetes.io/projected/469070c9-6c31-445c-8795-55e304582f6e-kube-api-access-s4x9s\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 13:06:48.162133 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:48.162087 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jmpjd\" (UniqueName: \"kubernetes.io/projected/9f64c58c-5a9c-446d-8e97-0893e17b4961-kube-api-access-jmpjd\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 13:06:48.162133 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:48.162097 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/469070c9-6c31-445c-8795-55e304582f6e-bundle\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 13:06:48.162133 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:48.162106 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/469070c9-6c31-445c-8795-55e304582f6e-util\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 13:06:48.162133 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:48.162114 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f64c58c-5a9c-446d-8e97-0893e17b4961-util\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 13:06:48.162133 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:48.162122 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f64c58c-5a9c-446d-8e97-0893e17b4961-bundle\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 13:06:48.850374 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:48.850341 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kkgzg" Jul 30 13:06:48.850374 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:48.850352 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kkgzg" event={"ID":"9f64c58c-5a9c-446d-8e97-0893e17b4961","Type":"ContainerDied","Data":"bb4046249344bb8a95009632537e6bf5b11e5db35047e80b10efc5cbd20dfaba"} Jul 30 13:06:48.850623 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:48.850400 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bb4046249344bb8a95009632537e6bf5b11e5db35047e80b10efc5cbd20dfaba" Jul 30 13:06:48.852403 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:48.852380 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g956q" Jul 30 13:06:48.852552 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:48.852483 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g956q" event={"ID":"469070c9-6c31-445c-8795-55e304582f6e","Type":"ContainerDied","Data":"f588c2fd6bf19af3a43d8de7d55cf5ea6f61a6ebe962c8f8d177ec27c3294f1b"} Jul 30 13:06:48.852552 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:48.852524 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f588c2fd6bf19af3a43d8de7d55cf5ea6f61a6ebe962c8f8d177ec27c3294f1b" Jul 30 13:06:56.265367 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:56.265327 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:06:58.688339 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:58.688299 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:06:59.066726 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:59.066689 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:06:59.189775 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:06:59.189737 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:07:01.718211 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:01.718173 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:07:03.339247 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:03.339210 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:07:04.092268 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:04.092237 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:07:06.280307 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:06.280261 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:07:06.730520 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:06.730487 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:07:07.015518 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:07.015406 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:07:07.115246 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:07.115206 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:07:09.746174 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:09.746136 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:07:11.103546 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:11.103514 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:07:11.201987 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:11.201945 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:07:11.929288 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:11.929258 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:07:12.025504 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:12.025469 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:07:14.683858 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:14.683827 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:07:14.747314 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:14.747277 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:07:22.202132 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:22.202094 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:07:22.314566 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:22.314527 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:07:26.933999 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:26.933966 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:07:27.029313 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:27.029272 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:07:29.402135 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:29.402082 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:07:29.509543 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:29.509493 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:07:32.766963 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:32.766928 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:07:32.865661 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:32.865626 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:07:39.815991 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:39.815948 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:07:39.916288 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:39.916248 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:07:44.614376 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:44.614341 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:07:44.713923 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:44.713881 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:07:47.344637 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:47.344602 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:07:47.450632 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:47.450592 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:07:51.029826 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:51.029790 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:07:51.130460 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:51.130397 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:07:52.109504 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:52.109469 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jnmtt"] Jul 30 13:07:52.109879 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:52.109838 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="919dcf41-659d-4a1a-bd60-02bacc954f13" containerName="util" Jul 30 13:07:52.109879 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:52.109850 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="919dcf41-659d-4a1a-bd60-02bacc954f13" containerName="util" Jul 30 13:07:52.109879 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:52.109860 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f64c58c-5a9c-446d-8e97-0893e17b4961" containerName="pull" Jul 30 13:07:52.109879 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:52.109866 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f64c58c-5a9c-446d-8e97-0893e17b4961" containerName="pull" Jul 30 13:07:52.109879 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:52.109874 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="469070c9-6c31-445c-8795-55e304582f6e" containerName="extract" Jul 30 13:07:52.110051 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:52.109881 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="469070c9-6c31-445c-8795-55e304582f6e" containerName="extract" Jul 30 13:07:52.110051 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:52.109892 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c46530cc-1c2f-47f1-9889-abbd30f314f8" containerName="extract" Jul 30 13:07:52.110051 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:52.109898 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c46530cc-1c2f-47f1-9889-abbd30f314f8" containerName="extract" Jul 30 13:07:52.110051 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:52.109913 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c46530cc-1c2f-47f1-9889-abbd30f314f8" containerName="util" Jul 30 13:07:52.110051 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:52.109918 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c46530cc-1c2f-47f1-9889-abbd30f314f8" containerName="util" Jul 30 13:07:52.110051 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:52.109925 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c46530cc-1c2f-47f1-9889-abbd30f314f8" containerName="pull" Jul 30 13:07:52.110051 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:52.109930 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c46530cc-1c2f-47f1-9889-abbd30f314f8" containerName="pull" Jul 30 13:07:52.110051 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:52.109937 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="919dcf41-659d-4a1a-bd60-02bacc954f13" containerName="extract" Jul 30 13:07:52.110051 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:52.109942 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="919dcf41-659d-4a1a-bd60-02bacc954f13" containerName="extract" Jul 30 13:07:52.110051 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:52.109949 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="469070c9-6c31-445c-8795-55e304582f6e" containerName="pull" Jul 30 13:07:52.110051 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:52.109954 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="469070c9-6c31-445c-8795-55e304582f6e" containerName="pull" Jul 30 13:07:52.110051 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:52.109972 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="919dcf41-659d-4a1a-bd60-02bacc954f13" containerName="pull" Jul 30 13:07:52.110051 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:52.109978 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="919dcf41-659d-4a1a-bd60-02bacc954f13" containerName="pull" Jul 30 13:07:52.110051 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:52.109984 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f64c58c-5a9c-446d-8e97-0893e17b4961" containerName="util" Jul 30 13:07:52.110051 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:52.109988 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f64c58c-5a9c-446d-8e97-0893e17b4961" containerName="util" Jul 30 13:07:52.110051 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:52.109995 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="469070c9-6c31-445c-8795-55e304582f6e" containerName="util" Jul 30 13:07:52.110051 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:52.109999 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="469070c9-6c31-445c-8795-55e304582f6e" containerName="util" Jul 30 13:07:52.110051 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:52.110006 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f64c58c-5a9c-446d-8e97-0893e17b4961" containerName="extract" Jul 30 13:07:52.110051 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:52.110011 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f64c58c-5a9c-446d-8e97-0893e17b4961" containerName="extract" Jul 30 13:07:52.110691 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:52.110072 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="c46530cc-1c2f-47f1-9889-abbd30f314f8" containerName="extract" Jul 30 13:07:52.110691 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:52.110083 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="469070c9-6c31-445c-8795-55e304582f6e" containerName="extract" Jul 30 13:07:52.110691 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:52.110088 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f64c58c-5a9c-446d-8e97-0893e17b4961" containerName="extract" Jul 30 13:07:52.110691 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:52.110096 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="919dcf41-659d-4a1a-bd60-02bacc954f13" containerName="extract" Jul 30 13:07:52.113056 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:52.113039 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jnmtt" Jul 30 13:07:52.115818 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:52.115800 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-hqwjk\"" Jul 30 13:07:52.125031 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:52.125007 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jnmtt"] Jul 30 13:07:52.135378 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:52.135345 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:07:52.235830 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:52.235791 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/900cf9c9-d235-48e9-b7e4-fc46e8e0b742-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jnmtt\" (UID: \"900cf9c9-d235-48e9-b7e4-fc46e8e0b742\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jnmtt" Jul 30 13:07:52.236022 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:52.235835 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/900cf9c9-d235-48e9-b7e4-fc46e8e0b742-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jnmtt\" (UID: \"900cf9c9-d235-48e9-b7e4-fc46e8e0b742\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jnmtt" Jul 30 13:07:52.236022 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:52.235868 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtrbz\" (UniqueName: \"kubernetes.io/projected/900cf9c9-d235-48e9-b7e4-fc46e8e0b742-kube-api-access-rtrbz\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jnmtt\" (UID: \"900cf9c9-d235-48e9-b7e4-fc46e8e0b742\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jnmtt" Jul 30 13:07:52.236022 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:52.235898 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/900cf9c9-d235-48e9-b7e4-fc46e8e0b742-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jnmtt\" (UID: \"900cf9c9-d235-48e9-b7e4-fc46e8e0b742\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jnmtt" Jul 30 13:07:52.236022 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:52.235969 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/900cf9c9-d235-48e9-b7e4-fc46e8e0b742-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jnmtt\" (UID: \"900cf9c9-d235-48e9-b7e4-fc46e8e0b742\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jnmtt" Jul 30 13:07:52.236022 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:52.235993 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/900cf9c9-d235-48e9-b7e4-fc46e8e0b742-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jnmtt\" (UID: \"900cf9c9-d235-48e9-b7e4-fc46e8e0b742\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jnmtt" Jul 30 13:07:52.236022 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:52.236017 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/900cf9c9-d235-48e9-b7e4-fc46e8e0b742-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jnmtt\" (UID: \"900cf9c9-d235-48e9-b7e4-fc46e8e0b742\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jnmtt" Jul 30 13:07:52.236283 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:52.236062 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/900cf9c9-d235-48e9-b7e4-fc46e8e0b742-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jnmtt\" (UID: \"900cf9c9-d235-48e9-b7e4-fc46e8e0b742\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jnmtt" Jul 30 13:07:52.236283 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:52.236104 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/900cf9c9-d235-48e9-b7e4-fc46e8e0b742-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jnmtt\" (UID: \"900cf9c9-d235-48e9-b7e4-fc46e8e0b742\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jnmtt" Jul 30 13:07:52.337018 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:52.336983 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/900cf9c9-d235-48e9-b7e4-fc46e8e0b742-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jnmtt\" (UID: \"900cf9c9-d235-48e9-b7e4-fc46e8e0b742\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jnmtt" Jul 30 13:07:52.337018 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:52.337032 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/900cf9c9-d235-48e9-b7e4-fc46e8e0b742-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jnmtt\" (UID: \"900cf9c9-d235-48e9-b7e4-fc46e8e0b742\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jnmtt" Jul 30 13:07:52.337295 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:52.337067 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/900cf9c9-d235-48e9-b7e4-fc46e8e0b742-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jnmtt\" (UID: \"900cf9c9-d235-48e9-b7e4-fc46e8e0b742\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jnmtt" Jul 30 13:07:52.337295 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:52.337093 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtrbz\" (UniqueName: \"kubernetes.io/projected/900cf9c9-d235-48e9-b7e4-fc46e8e0b742-kube-api-access-rtrbz\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jnmtt\" (UID: \"900cf9c9-d235-48e9-b7e4-fc46e8e0b742\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jnmtt" Jul 30 13:07:52.337295 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:52.337132 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/900cf9c9-d235-48e9-b7e4-fc46e8e0b742-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jnmtt\" (UID: \"900cf9c9-d235-48e9-b7e4-fc46e8e0b742\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jnmtt" Jul 30 13:07:52.337295 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:52.337208 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/900cf9c9-d235-48e9-b7e4-fc46e8e0b742-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jnmtt\" (UID: \"900cf9c9-d235-48e9-b7e4-fc46e8e0b742\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jnmtt" Jul 30 13:07:52.337295 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:52.337234 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/900cf9c9-d235-48e9-b7e4-fc46e8e0b742-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jnmtt\" (UID: \"900cf9c9-d235-48e9-b7e4-fc46e8e0b742\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jnmtt" Jul 30 13:07:52.337295 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:52.337265 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/900cf9c9-d235-48e9-b7e4-fc46e8e0b742-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jnmtt\" (UID: \"900cf9c9-d235-48e9-b7e4-fc46e8e0b742\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jnmtt" Jul 30 13:07:52.337634 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:52.337610 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/900cf9c9-d235-48e9-b7e4-fc46e8e0b742-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jnmtt\" (UID: \"900cf9c9-d235-48e9-b7e4-fc46e8e0b742\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jnmtt" Jul 30 13:07:52.337727 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:52.337677 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/900cf9c9-d235-48e9-b7e4-fc46e8e0b742-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jnmtt\" (UID: \"900cf9c9-d235-48e9-b7e4-fc46e8e0b742\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jnmtt" Jul 30 13:07:52.337867 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:52.337802 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/900cf9c9-d235-48e9-b7e4-fc46e8e0b742-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jnmtt\" (UID: \"900cf9c9-d235-48e9-b7e4-fc46e8e0b742\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jnmtt" Jul 30 13:07:52.337955 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:52.337937 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/900cf9c9-d235-48e9-b7e4-fc46e8e0b742-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jnmtt\" (UID: \"900cf9c9-d235-48e9-b7e4-fc46e8e0b742\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jnmtt" Jul 30 13:07:52.338235 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:52.338216 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/900cf9c9-d235-48e9-b7e4-fc46e8e0b742-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jnmtt\" (UID: \"900cf9c9-d235-48e9-b7e4-fc46e8e0b742\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jnmtt" Jul 30 13:07:52.338532 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:52.338508 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/900cf9c9-d235-48e9-b7e4-fc46e8e0b742-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jnmtt\" (UID: \"900cf9c9-d235-48e9-b7e4-fc46e8e0b742\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jnmtt" Jul 30 13:07:52.339863 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:52.339835 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/900cf9c9-d235-48e9-b7e4-fc46e8e0b742-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jnmtt\" (UID: \"900cf9c9-d235-48e9-b7e4-fc46e8e0b742\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jnmtt" Jul 30 13:07:52.339979 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:52.339961 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/900cf9c9-d235-48e9-b7e4-fc46e8e0b742-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jnmtt\" (UID: \"900cf9c9-d235-48e9-b7e4-fc46e8e0b742\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jnmtt" Jul 30 13:07:52.345169 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:52.345135 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtrbz\" (UniqueName: \"kubernetes.io/projected/900cf9c9-d235-48e9-b7e4-fc46e8e0b742-kube-api-access-rtrbz\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jnmtt\" (UID: \"900cf9c9-d235-48e9-b7e4-fc46e8e0b742\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jnmtt" Jul 30 13:07:52.345304 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:52.345285 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/900cf9c9-d235-48e9-b7e4-fc46e8e0b742-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jnmtt\" (UID: \"900cf9c9-d235-48e9-b7e4-fc46e8e0b742\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jnmtt" Jul 30 13:07:52.398474 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:52.398356 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:07:52.424217 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:52.424178 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jnmtt" Jul 30 13:07:52.561007 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:52.560979 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jnmtt"] Jul 30 13:07:52.562960 ip-10-0-133-230 kubenswrapper[2579]: W0730 13:07:52.562933 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod900cf9c9_d235_48e9_b7e4_fc46e8e0b742.slice/crio-0779ae96d0f1fcd68c7c8d1d2ff5b59d80b955141b6ce1fb600a64678ba3e947 WatchSource:0}: Error finding container 0779ae96d0f1fcd68c7c8d1d2ff5b59d80b955141b6ce1fb600a64678ba3e947: Status 404 returned error can't find the container with id 0779ae96d0f1fcd68c7c8d1d2ff5b59d80b955141b6ce1fb600a64678ba3e947 Jul 30 13:07:52.565475 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:52.565442 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 30 13:07:52.565547 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:52.565525 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 30 13:07:52.565585 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:52.565553 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 30 13:07:53.186799 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:53.186764 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jnmtt" event={"ID":"900cf9c9-d235-48e9-b7e4-fc46e8e0b742","Type":"ContainerStarted","Data":"ccf63e190c66d9a72cb26124657232c1f0ca7448b47fb17cdfcf8b716709a71a"} Jul 30 13:07:53.187192 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:53.186821 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jnmtt" event={"ID":"900cf9c9-d235-48e9-b7e4-fc46e8e0b742","Type":"ContainerStarted","Data":"0779ae96d0f1fcd68c7c8d1d2ff5b59d80b955141b6ce1fb600a64678ba3e947"} Jul 30 13:07:53.210570 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:53.210521 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jnmtt" podStartSLOduration=1.210505475 podStartE2EDuration="1.210505475s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:07:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:07:53.209630273 +0000 UTC m=+521.041096400" watchObservedRunningTime="2026-07-30 13:07:53.210505475 +0000 UTC m=+521.041971600" Jul 30 13:07:53.424920 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:53.424886 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jnmtt" Jul 30 13:07:53.429791 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:53.429767 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jnmtt" Jul 30 13:07:54.193005 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:54.192974 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jnmtt" Jul 30 13:07:54.193801 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:54.193784 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jnmtt" Jul 30 13:07:54.280228 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:54.280187 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:07:54.374489 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:54.374454 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:07:54.474814 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:54.474778 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:07:55.146877 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:55.146844 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:07:55.223136 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:55.223098 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:07:56.845610 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:56.845575 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:07:58.618655 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:58.618618 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:07:58.741482 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:07:58.741408 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:08:04.050405 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:04.050364 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:08:04.165108 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:04.165074 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:08:04.414646 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:04.414537 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:08:04.484181 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:04.484150 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:08:07.376182 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:07.376085 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:08:07.476328 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:07.476291 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:08:16.981132 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:16.981091 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:08:17.056800 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:17.056761 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:08:17.267503 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:17.267401 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-57684fd498-sd7hr"] Jul 30 13:08:17.271066 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:17.271044 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57684fd498-sd7hr" Jul 30 13:08:17.285270 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:17.285246 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57684fd498-sd7hr"] Jul 30 13:08:17.331861 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:17.331830 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:08:17.461344 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:17.461302 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c091fcff-8a82-4546-b874-ab4e50b89183-service-ca\") pod \"console-57684fd498-sd7hr\" (UID: \"c091fcff-8a82-4546-b874-ab4e50b89183\") " pod="openshift-console/console-57684fd498-sd7hr" Jul 30 13:08:17.461344 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:17.461348 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c091fcff-8a82-4546-b874-ab4e50b89183-console-serving-cert\") pod \"console-57684fd498-sd7hr\" (UID: \"c091fcff-8a82-4546-b874-ab4e50b89183\") " pod="openshift-console/console-57684fd498-sd7hr" Jul 30 13:08:17.461635 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:17.461373 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c091fcff-8a82-4546-b874-ab4e50b89183-console-oauth-config\") pod \"console-57684fd498-sd7hr\" (UID: \"c091fcff-8a82-4546-b874-ab4e50b89183\") " pod="openshift-console/console-57684fd498-sd7hr" Jul 30 13:08:17.461635 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:17.461473 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c091fcff-8a82-4546-b874-ab4e50b89183-oauth-serving-cert\") pod \"console-57684fd498-sd7hr\" (UID: \"c091fcff-8a82-4546-b874-ab4e50b89183\") " pod="openshift-console/console-57684fd498-sd7hr" Jul 30 13:08:17.461635 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:17.461516 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7scw\" (UniqueName: \"kubernetes.io/projected/c091fcff-8a82-4546-b874-ab4e50b89183-kube-api-access-l7scw\") pod \"console-57684fd498-sd7hr\" (UID: \"c091fcff-8a82-4546-b874-ab4e50b89183\") " pod="openshift-console/console-57684fd498-sd7hr" Jul 30 13:08:17.461635 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:17.461600 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c091fcff-8a82-4546-b874-ab4e50b89183-console-config\") pod \"console-57684fd498-sd7hr\" (UID: \"c091fcff-8a82-4546-b874-ab4e50b89183\") " pod="openshift-console/console-57684fd498-sd7hr" Jul 30 13:08:17.461815 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:17.461636 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c091fcff-8a82-4546-b874-ab4e50b89183-trusted-ca-bundle\") pod \"console-57684fd498-sd7hr\" (UID: \"c091fcff-8a82-4546-b874-ab4e50b89183\") " pod="openshift-console/console-57684fd498-sd7hr" Jul 30 13:08:17.562949 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:17.562854 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7scw\" (UniqueName: \"kubernetes.io/projected/c091fcff-8a82-4546-b874-ab4e50b89183-kube-api-access-l7scw\") pod \"console-57684fd498-sd7hr\" (UID: \"c091fcff-8a82-4546-b874-ab4e50b89183\") " pod="openshift-console/console-57684fd498-sd7hr" Jul 30 13:08:17.562949 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:17.562909 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c091fcff-8a82-4546-b874-ab4e50b89183-console-config\") pod \"console-57684fd498-sd7hr\" (UID: \"c091fcff-8a82-4546-b874-ab4e50b89183\") " pod="openshift-console/console-57684fd498-sd7hr" Jul 30 13:08:17.562949 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:17.562926 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c091fcff-8a82-4546-b874-ab4e50b89183-trusted-ca-bundle\") pod \"console-57684fd498-sd7hr\" (UID: \"c091fcff-8a82-4546-b874-ab4e50b89183\") " pod="openshift-console/console-57684fd498-sd7hr" Jul 30 13:08:17.563227 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:17.562991 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c091fcff-8a82-4546-b874-ab4e50b89183-service-ca\") pod \"console-57684fd498-sd7hr\" (UID: \"c091fcff-8a82-4546-b874-ab4e50b89183\") " pod="openshift-console/console-57684fd498-sd7hr" Jul 30 13:08:17.563227 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:17.563022 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c091fcff-8a82-4546-b874-ab4e50b89183-console-serving-cert\") pod \"console-57684fd498-sd7hr\" (UID: \"c091fcff-8a82-4546-b874-ab4e50b89183\") " pod="openshift-console/console-57684fd498-sd7hr" Jul 30 13:08:17.563227 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:17.563065 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c091fcff-8a82-4546-b874-ab4e50b89183-console-oauth-config\") pod \"console-57684fd498-sd7hr\" (UID: \"c091fcff-8a82-4546-b874-ab4e50b89183\") " pod="openshift-console/console-57684fd498-sd7hr" Jul 30 13:08:17.563227 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:17.563114 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c091fcff-8a82-4546-b874-ab4e50b89183-oauth-serving-cert\") pod \"console-57684fd498-sd7hr\" (UID: \"c091fcff-8a82-4546-b874-ab4e50b89183\") " pod="openshift-console/console-57684fd498-sd7hr" Jul 30 13:08:17.563789 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:17.563764 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c091fcff-8a82-4546-b874-ab4e50b89183-console-config\") pod \"console-57684fd498-sd7hr\" (UID: \"c091fcff-8a82-4546-b874-ab4e50b89183\") " pod="openshift-console/console-57684fd498-sd7hr" Jul 30 13:08:17.563907 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:17.563814 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c091fcff-8a82-4546-b874-ab4e50b89183-oauth-serving-cert\") pod \"console-57684fd498-sd7hr\" (UID: \"c091fcff-8a82-4546-b874-ab4e50b89183\") " pod="openshift-console/console-57684fd498-sd7hr" Jul 30 13:08:17.563907 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:17.563775 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c091fcff-8a82-4546-b874-ab4e50b89183-service-ca\") pod \"console-57684fd498-sd7hr\" (UID: \"c091fcff-8a82-4546-b874-ab4e50b89183\") " pod="openshift-console/console-57684fd498-sd7hr" Jul 30 13:08:17.563989 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:17.563937 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c091fcff-8a82-4546-b874-ab4e50b89183-trusted-ca-bundle\") pod \"console-57684fd498-sd7hr\" (UID: \"c091fcff-8a82-4546-b874-ab4e50b89183\") " pod="openshift-console/console-57684fd498-sd7hr" Jul 30 13:08:17.565954 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:17.565928 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c091fcff-8a82-4546-b874-ab4e50b89183-console-oauth-config\") pod \"console-57684fd498-sd7hr\" (UID: \"c091fcff-8a82-4546-b874-ab4e50b89183\") " pod="openshift-console/console-57684fd498-sd7hr" Jul 30 13:08:17.566201 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:17.566180 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c091fcff-8a82-4546-b874-ab4e50b89183-console-serving-cert\") pod \"console-57684fd498-sd7hr\" (UID: \"c091fcff-8a82-4546-b874-ab4e50b89183\") " pod="openshift-console/console-57684fd498-sd7hr" Jul 30 13:08:17.571553 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:17.571528 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7scw\" (UniqueName: \"kubernetes.io/projected/c091fcff-8a82-4546-b874-ab4e50b89183-kube-api-access-l7scw\") pod \"console-57684fd498-sd7hr\" (UID: \"c091fcff-8a82-4546-b874-ab4e50b89183\") " pod="openshift-console/console-57684fd498-sd7hr" Jul 30 13:08:17.580296 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:17.580277 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57684fd498-sd7hr" Jul 30 13:08:17.713265 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:17.713229 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57684fd498-sd7hr"] Jul 30 13:08:17.715041 ip-10-0-133-230 kubenswrapper[2579]: W0730 13:08:17.715012 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc091fcff_8a82_4546_b874_ab4e50b89183.slice/crio-ceb76dbe7705fcc6754949d83f14ed62b76050bd8ff20e51134efbf55ac63b7f WatchSource:0}: Error finding container ceb76dbe7705fcc6754949d83f14ed62b76050bd8ff20e51134efbf55ac63b7f: Status 404 returned error can't find the container with id ceb76dbe7705fcc6754949d83f14ed62b76050bd8ff20e51134efbf55ac63b7f Jul 30 13:08:18.319434 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:18.319380 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57684fd498-sd7hr" event={"ID":"c091fcff-8a82-4546-b874-ab4e50b89183","Type":"ContainerStarted","Data":"cdb6105bbd719770c8a63d97bd5bc40bf18bbe946306522d26d6c64b614a0c99"} Jul 30 13:08:18.319811 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:18.319447 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57684fd498-sd7hr" event={"ID":"c091fcff-8a82-4546-b874-ab4e50b89183","Type":"ContainerStarted","Data":"ceb76dbe7705fcc6754949d83f14ed62b76050bd8ff20e51134efbf55ac63b7f"} Jul 30 13:08:18.339030 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:18.338972 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-57684fd498-sd7hr" podStartSLOduration=1.338953201 podStartE2EDuration="1.338953201s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:08:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:08:18.338775317 +0000 UTC m=+546.170241464" watchObservedRunningTime="2026-07-30 13:08:18.338953201 +0000 UTC m=+546.170419330" Jul 30 13:08:18.908679 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:18.908644 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:08:27.581018 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:27.580971 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-57684fd498-sd7hr" Jul 30 13:08:27.581533 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:27.581049 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-57684fd498-sd7hr" Jul 30 13:08:27.586120 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:27.586093 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-57684fd498-sd7hr" Jul 30 13:08:28.326921 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:28.326888 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:08:28.374490 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:28.374460 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-57684fd498-sd7hr" Jul 30 13:08:28.430204 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:28.430169 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bb9bb88dd-l7j87"] Jul 30 13:08:28.459502 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:28.459465 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:08:28.604884 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:28.604783 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:08:28.704696 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:28.704662 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:08:28.806518 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:28.806479 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:08:35.903837 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:35.903791 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:08:36.061511 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:36.061483 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:08:36.142760 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:36.142724 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:08:39.081376 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:39.081338 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:08:39.167698 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:39.167651 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:08:50.525849 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:50.525808 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:08:50.626066 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:50.626027 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:08:52.205919 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:52.205880 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:08:52.305231 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:52.305197 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:08:53.456263 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:53.456222 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-bb9bb88dd-l7j87" podUID="7107c095-9a94-4531-9169-0b77f21cb204" containerName="console" containerID="cri-o://f5de8b41bb276e3a97f1036240b7e6d445d168498d3814f8cc5fdb7afbf3958c" gracePeriod=15 Jul 30 13:08:53.710817 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:53.710756 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bb9bb88dd-l7j87" Jul 30 13:08:53.795086 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:53.795049 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5v274\" (UniqueName: \"kubernetes.io/projected/7107c095-9a94-4531-9169-0b77f21cb204-kube-api-access-5v274\") pod \"7107c095-9a94-4531-9169-0b77f21cb204\" (UID: \"7107c095-9a94-4531-9169-0b77f21cb204\") " Jul 30 13:08:53.795254 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:53.795105 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7107c095-9a94-4531-9169-0b77f21cb204-console-config\") pod \"7107c095-9a94-4531-9169-0b77f21cb204\" (UID: \"7107c095-9a94-4531-9169-0b77f21cb204\") " Jul 30 13:08:53.795254 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:53.795153 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7107c095-9a94-4531-9169-0b77f21cb204-trusted-ca-bundle\") pod \"7107c095-9a94-4531-9169-0b77f21cb204\" (UID: \"7107c095-9a94-4531-9169-0b77f21cb204\") " Jul 30 13:08:53.795254 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:53.795202 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7107c095-9a94-4531-9169-0b77f21cb204-service-ca\") pod \"7107c095-9a94-4531-9169-0b77f21cb204\" (UID: \"7107c095-9a94-4531-9169-0b77f21cb204\") " Jul 30 13:08:53.795437 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:53.795338 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7107c095-9a94-4531-9169-0b77f21cb204-console-serving-cert\") pod \"7107c095-9a94-4531-9169-0b77f21cb204\" (UID: \"7107c095-9a94-4531-9169-0b77f21cb204\") " Jul 30 13:08:53.795437 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:53.795382 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7107c095-9a94-4531-9169-0b77f21cb204-console-oauth-config\") pod \"7107c095-9a94-4531-9169-0b77f21cb204\" (UID: \"7107c095-9a94-4531-9169-0b77f21cb204\") " Jul 30 13:08:53.795549 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:53.795471 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7107c095-9a94-4531-9169-0b77f21cb204-oauth-serving-cert\") pod \"7107c095-9a94-4531-9169-0b77f21cb204\" (UID: \"7107c095-9a94-4531-9169-0b77f21cb204\") " Jul 30 13:08:53.795665 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:53.795640 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7107c095-9a94-4531-9169-0b77f21cb204-service-ca" (OuterVolumeSpecName: "service-ca") pod "7107c095-9a94-4531-9169-0b77f21cb204" (UID: "7107c095-9a94-4531-9169-0b77f21cb204"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 13:08:53.795932 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:53.795649 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7107c095-9a94-4531-9169-0b77f21cb204-console-config" (OuterVolumeSpecName: "console-config") pod "7107c095-9a94-4531-9169-0b77f21cb204" (UID: "7107c095-9a94-4531-9169-0b77f21cb204"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 13:08:53.796048 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:53.795668 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7107c095-9a94-4531-9169-0b77f21cb204-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "7107c095-9a94-4531-9169-0b77f21cb204" (UID: "7107c095-9a94-4531-9169-0b77f21cb204"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 13:08:53.796166 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:53.796058 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7107c095-9a94-4531-9169-0b77f21cb204-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7107c095-9a94-4531-9169-0b77f21cb204" (UID: "7107c095-9a94-4531-9169-0b77f21cb204"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 13:08:53.797344 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:53.797321 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7107c095-9a94-4531-9169-0b77f21cb204-kube-api-access-5v274" (OuterVolumeSpecName: "kube-api-access-5v274") pod "7107c095-9a94-4531-9169-0b77f21cb204" (UID: "7107c095-9a94-4531-9169-0b77f21cb204"). InnerVolumeSpecName "kube-api-access-5v274". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 13:08:53.797447 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:53.797403 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7107c095-9a94-4531-9169-0b77f21cb204-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7107c095-9a94-4531-9169-0b77f21cb204" (UID: "7107c095-9a94-4531-9169-0b77f21cb204"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 30 13:08:53.797500 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:53.797471 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7107c095-9a94-4531-9169-0b77f21cb204-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7107c095-9a94-4531-9169-0b77f21cb204" (UID: "7107c095-9a94-4531-9169-0b77f21cb204"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 30 13:08:53.897321 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:53.897287 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5v274\" (UniqueName: \"kubernetes.io/projected/7107c095-9a94-4531-9169-0b77f21cb204-kube-api-access-5v274\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 13:08:53.897321 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:53.897316 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7107c095-9a94-4531-9169-0b77f21cb204-console-config\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 13:08:53.897321 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:53.897328 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7107c095-9a94-4531-9169-0b77f21cb204-trusted-ca-bundle\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 13:08:53.897578 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:53.897340 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7107c095-9a94-4531-9169-0b77f21cb204-service-ca\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 13:08:53.897578 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:53.897352 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7107c095-9a94-4531-9169-0b77f21cb204-console-serving-cert\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 13:08:53.897578 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:53.897364 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7107c095-9a94-4531-9169-0b77f21cb204-console-oauth-config\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 13:08:53.897578 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:53.897374 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7107c095-9a94-4531-9169-0b77f21cb204-oauth-serving-cert\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 13:08:54.503573 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:54.503538 2579 generic.go:356] "Generic (PLEG): container finished" podID="7107c095-9a94-4531-9169-0b77f21cb204" containerID="f5de8b41bb276e3a97f1036240b7e6d445d168498d3814f8cc5fdb7afbf3958c" exitCode=0 Jul 30 13:08:54.503968 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:54.503595 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bb9bb88dd-l7j87" Jul 30 13:08:54.503968 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:54.503621 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bb9bb88dd-l7j87" event={"ID":"7107c095-9a94-4531-9169-0b77f21cb204","Type":"ContainerDied","Data":"f5de8b41bb276e3a97f1036240b7e6d445d168498d3814f8cc5fdb7afbf3958c"} Jul 30 13:08:54.503968 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:54.503695 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bb9bb88dd-l7j87" event={"ID":"7107c095-9a94-4531-9169-0b77f21cb204","Type":"ContainerDied","Data":"8e17ab5b6cd6368f39e2ebadae94bf09757d5ada808f7a663cb4bb00b1adf9e0"} Jul 30 13:08:54.503968 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:54.503718 2579 scope.go:117] "RemoveContainer" containerID="f5de8b41bb276e3a97f1036240b7e6d445d168498d3814f8cc5fdb7afbf3958c" Jul 30 13:08:54.512913 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:54.512898 2579 scope.go:117] "RemoveContainer" containerID="f5de8b41bb276e3a97f1036240b7e6d445d168498d3814f8cc5fdb7afbf3958c" Jul 30 13:08:54.513167 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:08:54.513150 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5de8b41bb276e3a97f1036240b7e6d445d168498d3814f8cc5fdb7afbf3958c\": container with ID starting with f5de8b41bb276e3a97f1036240b7e6d445d168498d3814f8cc5fdb7afbf3958c not found: ID does not exist" containerID="f5de8b41bb276e3a97f1036240b7e6d445d168498d3814f8cc5fdb7afbf3958c" Jul 30 13:08:54.513210 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:54.513175 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5de8b41bb276e3a97f1036240b7e6d445d168498d3814f8cc5fdb7afbf3958c"} err="failed to get container status \"f5de8b41bb276e3a97f1036240b7e6d445d168498d3814f8cc5fdb7afbf3958c\": rpc error: code = NotFound desc = could not find container \"f5de8b41bb276e3a97f1036240b7e6d445d168498d3814f8cc5fdb7afbf3958c\": container with ID starting with f5de8b41bb276e3a97f1036240b7e6d445d168498d3814f8cc5fdb7afbf3958c not found: ID does not exist" Jul 30 13:08:54.528847 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:54.528819 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bb9bb88dd-l7j87"] Jul 30 13:08:54.534656 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:54.534635 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-bb9bb88dd-l7j87"] Jul 30 13:08:54.707239 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:08:54.707204 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7107c095-9a94-4531-9169-0b77f21cb204" path="/var/lib/kubelet/pods/7107c095-9a94-4531-9169-0b77f21cb204/volumes" Jul 30 13:09:10.699036 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:09:10.698997 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:09:10.793612 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:09:10.793572 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:09:12.802226 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:09:12.802183 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:09:12.880446 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:09:12.880393 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:09:12.946871 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:09:12.946781 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:09:20.648599 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:09:20.648496 2579 generic.go:356] "Generic (PLEG): container finished" podID="900cf9c9-d235-48e9-b7e4-fc46e8e0b742" containerID="ccf63e190c66d9a72cb26124657232c1f0ca7448b47fb17cdfcf8b716709a71a" exitCode=0 Jul 30 13:09:20.648599 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:09:20.648573 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jnmtt" event={"ID":"900cf9c9-d235-48e9-b7e4-fc46e8e0b742","Type":"ContainerDied","Data":"ccf63e190c66d9a72cb26124657232c1f0ca7448b47fb17cdfcf8b716709a71a"} Jul 30 13:09:20.649067 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:09:20.648945 2579 scope.go:117] "RemoveContainer" containerID="ccf63e190c66d9a72cb26124657232c1f0ca7448b47fb17cdfcf8b716709a71a" Jul 30 13:09:20.649947 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:09:20.649920 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 30 13:09:20.650002 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:09:20.649985 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 30 13:09:20.650039 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:09:20.650018 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 30 13:09:21.658798 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:09:21.658754 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jnmtt" event={"ID":"900cf9c9-d235-48e9-b7e4-fc46e8e0b742","Type":"ContainerStarted","Data":"87c08ad8af76c14fc83650ddf8d29234dd1163df24a661f1b95cefef8abe113c"} Jul 30 13:09:22.250208 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:09:22.250157 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:09:22.351109 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:09:22.351065 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:09:22.424704 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:09:22.424669 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jnmtt" Jul 30 13:09:22.425828 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:09:22.425806 2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-jnmtt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body= Jul 30 13:09:22.425904 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:09:22.425868 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jnmtt" podUID="900cf9c9-d235-48e9-b7e4-fc46e8e0b742" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" Jul 30 13:09:23.425522 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:09:23.425482 2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-jnmtt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body= Jul 30 13:09:23.425907 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:09:23.425551 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jnmtt" podUID="900cf9c9-d235-48e9-b7e4-fc46e8e0b742" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" Jul 30 13:09:24.193134 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:09:24.193093 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jnmtt" Jul 30 13:09:24.424928 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:09:24.424892 2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-jnmtt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body= Jul 30 13:09:24.425106 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:09:24.424947 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jnmtt" podUID="900cf9c9-d235-48e9-b7e4-fc46e8e0b742" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" Jul 30 13:09:25.425003 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:09:25.424965 2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-jnmtt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body= Jul 30 13:09:25.425396 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:09:25.425014 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jnmtt" podUID="900cf9c9-d235-48e9-b7e4-fc46e8e0b742" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" Jul 30 13:09:26.429066 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:09:26.429041 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jnmtt" Jul 30 13:09:26.430141 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:09:26.430125 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jnmtt" Jul 30 13:09:31.480214 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:09:31.480143 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:09:38.570951 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:09:38.570871 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-zmj6m"] Jul 30 13:09:38.571403 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:09:38.571386 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7107c095-9a94-4531-9169-0b77f21cb204" containerName="console" Jul 30 13:09:38.571469 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:09:38.571405 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7107c095-9a94-4531-9169-0b77f21cb204" containerName="console" Jul 30 13:09:38.571505 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:09:38.571499 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="7107c095-9a94-4531-9169-0b77f21cb204" containerName="console" Jul 30 13:09:38.574892 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:09:38.574872 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zmj6m" Jul 30 13:09:38.581869 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:09:38.581849 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-6m8gs\"" Jul 30 13:09:38.581983 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:09:38.581849 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 30 13:09:38.581983 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:09:38.581850 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 30 13:09:38.582198 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:09:38.582183 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 30 13:09:38.588348 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:09:38.588322 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-zmj6m"] Jul 30 13:09:38.614092 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:09:38.614057 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:09:38.710266 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:09:38.710231 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b59a8d42-7a93-4879-8c6d-7db76d48e92d-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zmj6m\" (UID: \"b59a8d42-7a93-4879-8c6d-7db76d48e92d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zmj6m" Jul 30 13:09:38.710484 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:09:38.710294 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b59a8d42-7a93-4879-8c6d-7db76d48e92d-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zmj6m\" (UID: \"b59a8d42-7a93-4879-8c6d-7db76d48e92d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zmj6m" Jul 30 13:09:38.710484 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:09:38.710341 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trgtq\" (UniqueName: \"kubernetes.io/projected/b59a8d42-7a93-4879-8c6d-7db76d48e92d-kube-api-access-trgtq\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zmj6m\" (UID: \"b59a8d42-7a93-4879-8c6d-7db76d48e92d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zmj6m" Jul 30 13:09:38.710615 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:09:38.710478 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b59a8d42-7a93-4879-8c6d-7db76d48e92d-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zmj6m\" (UID: \"b59a8d42-7a93-4879-8c6d-7db76d48e92d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zmj6m" Jul 30 13:09:38.710615 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:09:38.710551 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b59a8d42-7a93-4879-8c6d-7db76d48e92d-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zmj6m\" (UID: \"b59a8d42-7a93-4879-8c6d-7db76d48e92d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zmj6m" Jul 30 13:09:38.710720 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:09:38.710645 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b59a8d42-7a93-4879-8c6d-7db76d48e92d-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zmj6m\" (UID: \"b59a8d42-7a93-4879-8c6d-7db76d48e92d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zmj6m" Jul 30 13:09:38.811926 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:09:38.811889 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b59a8d42-7a93-4879-8c6d-7db76d48e92d-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zmj6m\" (UID: \"b59a8d42-7a93-4879-8c6d-7db76d48e92d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zmj6m" Jul 30 13:09:38.812113 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:09:38.811945 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b59a8d42-7a93-4879-8c6d-7db76d48e92d-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zmj6m\" (UID: \"b59a8d42-7a93-4879-8c6d-7db76d48e92d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zmj6m" Jul 30 13:09:38.812113 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:09:38.811975 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b59a8d42-7a93-4879-8c6d-7db76d48e92d-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zmj6m\" (UID: \"b59a8d42-7a93-4879-8c6d-7db76d48e92d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zmj6m" Jul 30 13:09:38.812113 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:09:38.811998 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b59a8d42-7a93-4879-8c6d-7db76d48e92d-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zmj6m\" (UID: \"b59a8d42-7a93-4879-8c6d-7db76d48e92d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zmj6m" Jul 30 13:09:38.812113 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:09:38.812024 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trgtq\" (UniqueName: \"kubernetes.io/projected/b59a8d42-7a93-4879-8c6d-7db76d48e92d-kube-api-access-trgtq\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zmj6m\" (UID: \"b59a8d42-7a93-4879-8c6d-7db76d48e92d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zmj6m" Jul 30 13:09:38.812113 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:09:38.812082 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b59a8d42-7a93-4879-8c6d-7db76d48e92d-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zmj6m\" (UID: \"b59a8d42-7a93-4879-8c6d-7db76d48e92d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zmj6m" Jul 30 13:09:38.812392 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:09:38.812354 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b59a8d42-7a93-4879-8c6d-7db76d48e92d-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zmj6m\" (UID: \"b59a8d42-7a93-4879-8c6d-7db76d48e92d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zmj6m" Jul 30 13:09:38.812497 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:09:38.812468 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b59a8d42-7a93-4879-8c6d-7db76d48e92d-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zmj6m\" (UID: \"b59a8d42-7a93-4879-8c6d-7db76d48e92d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zmj6m" Jul 30 13:09:38.812551 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:09:38.812510 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b59a8d42-7a93-4879-8c6d-7db76d48e92d-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zmj6m\" (UID: \"b59a8d42-7a93-4879-8c6d-7db76d48e92d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zmj6m" Jul 30 13:09:38.814337 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:09:38.814301 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b59a8d42-7a93-4879-8c6d-7db76d48e92d-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zmj6m\" (UID: \"b59a8d42-7a93-4879-8c6d-7db76d48e92d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zmj6m" Jul 30 13:09:38.814597 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:09:38.814578 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b59a8d42-7a93-4879-8c6d-7db76d48e92d-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zmj6m\" (UID: \"b59a8d42-7a93-4879-8c6d-7db76d48e92d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zmj6m" Jul 30 13:09:38.820453 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:09:38.820430 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-trgtq\" (UniqueName: \"kubernetes.io/projected/b59a8d42-7a93-4879-8c6d-7db76d48e92d-kube-api-access-trgtq\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zmj6m\" (UID: \"b59a8d42-7a93-4879-8c6d-7db76d48e92d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zmj6m" Jul 30 13:09:38.885462 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:09:38.885337 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zmj6m" Jul 30 13:09:39.026989 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:09:39.026947 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-zmj6m"] Jul 30 13:09:39.031773 ip-10-0-133-230 kubenswrapper[2579]: W0730 13:09:39.031743 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb59a8d42_7a93_4879_8c6d_7db76d48e92d.slice/crio-9eb102fd190ee48510a7d0f706a3a1961ac1ae9cf2ae7ae88897bfb9f63a0303 WatchSource:0}: Error finding container 9eb102fd190ee48510a7d0f706a3a1961ac1ae9cf2ae7ae88897bfb9f63a0303: Status 404 returned error can't find the container with id 9eb102fd190ee48510a7d0f706a3a1961ac1ae9cf2ae7ae88897bfb9f63a0303 Jul 30 13:09:39.033111 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:09:39.033091 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 30 13:09:39.755913 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:09:39.755877 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zmj6m" event={"ID":"b59a8d42-7a93-4879-8c6d-7db76d48e92d","Type":"ContainerStarted","Data":"9eb102fd190ee48510a7d0f706a3a1961ac1ae9cf2ae7ae88897bfb9f63a0303"} Jul 30 13:09:40.762606 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:09:40.762560 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zmj6m" event={"ID":"b59a8d42-7a93-4879-8c6d-7db76d48e92d","Type":"ContainerStarted","Data":"af6884f01f4ceb89f99d7cf6327f56cc9ffaf37e89e92c36395d849eab858a17"} Jul 30 13:09:40.780136 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:09:40.780089 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zmj6m" podStartSLOduration=1.5006351100000002 podStartE2EDuration="2.780074388s" totalImagesPullingTime="1.279439278s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:09:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:09:40.779190928 +0000 UTC m=+628.610657074" watchObservedRunningTime="2026-07-30 13:09:40.780074388 +0000 UTC m=+628.611540512" Jul 30 13:09:48.885978 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:09:48.885933 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zmj6m" Jul 30 13:09:48.886466 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:09:48.886005 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zmj6m" Jul 30 13:09:48.898554 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:09:48.898528 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zmj6m" Jul 30 13:09:49.818767 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:09:49.818723 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zmj6m" Jul 30 13:09:59.868944 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:09:59.868904 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:10:00.207357 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:10:00.207319 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:10:03.843334 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:10:03.843302 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvkqpn"] Jul 30 13:10:03.846883 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:10:03.846866 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvkqpn" Jul 30 13:10:03.849652 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:10:03.849632 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 30 13:10:03.857267 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:10:03.857245 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvkqpn"] Jul 30 13:10:03.874862 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:10:03.874828 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:10:03.949593 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:10:03.949557 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/94a17c8b-a4ef-4aec-938d-764c45085cd8-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvkqpn\" (UID: \"94a17c8b-a4ef-4aec-938d-764c45085cd8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvkqpn" Jul 30 13:10:03.949778 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:10:03.949672 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94a17c8b-a4ef-4aec-938d-764c45085cd8-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvkqpn\" (UID: \"94a17c8b-a4ef-4aec-938d-764c45085cd8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvkqpn" Jul 30 13:10:03.949778 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:10:03.949704 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pj4f2\" (UniqueName: \"kubernetes.io/projected/94a17c8b-a4ef-4aec-938d-764c45085cd8-kube-api-access-pj4f2\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvkqpn\" (UID: \"94a17c8b-a4ef-4aec-938d-764c45085cd8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvkqpn" Jul 30 13:10:03.949778 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:10:03.949729 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/94a17c8b-a4ef-4aec-938d-764c45085cd8-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvkqpn\" (UID: \"94a17c8b-a4ef-4aec-938d-764c45085cd8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvkqpn" Jul 30 13:10:03.949778 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:10:03.949760 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/94a17c8b-a4ef-4aec-938d-764c45085cd8-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvkqpn\" (UID: \"94a17c8b-a4ef-4aec-938d-764c45085cd8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvkqpn" Jul 30 13:10:03.949983 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:10:03.949890 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/94a17c8b-a4ef-4aec-938d-764c45085cd8-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvkqpn\" (UID: \"94a17c8b-a4ef-4aec-938d-764c45085cd8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvkqpn" Jul 30 13:10:04.050482 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:10:04.050446 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94a17c8b-a4ef-4aec-938d-764c45085cd8-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvkqpn\" (UID: \"94a17c8b-a4ef-4aec-938d-764c45085cd8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvkqpn" Jul 30 13:10:04.050482 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:10:04.050485 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pj4f2\" (UniqueName: \"kubernetes.io/projected/94a17c8b-a4ef-4aec-938d-764c45085cd8-kube-api-access-pj4f2\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvkqpn\" (UID: \"94a17c8b-a4ef-4aec-938d-764c45085cd8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvkqpn" Jul 30 13:10:04.050749 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:10:04.050506 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/94a17c8b-a4ef-4aec-938d-764c45085cd8-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvkqpn\" (UID: \"94a17c8b-a4ef-4aec-938d-764c45085cd8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvkqpn" Jul 30 13:10:04.050749 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:10:04.050624 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/94a17c8b-a4ef-4aec-938d-764c45085cd8-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvkqpn\" (UID: \"94a17c8b-a4ef-4aec-938d-764c45085cd8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvkqpn" Jul 30 13:10:04.050749 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:10:04.050697 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/94a17c8b-a4ef-4aec-938d-764c45085cd8-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvkqpn\" (UID: \"94a17c8b-a4ef-4aec-938d-764c45085cd8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvkqpn" Jul 30 13:10:04.050749 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:10:04.050732 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/94a17c8b-a4ef-4aec-938d-764c45085cd8-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvkqpn\" (UID: \"94a17c8b-a4ef-4aec-938d-764c45085cd8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvkqpn" Jul 30 13:10:04.050988 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:10:04.050923 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94a17c8b-a4ef-4aec-938d-764c45085cd8-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvkqpn\" (UID: \"94a17c8b-a4ef-4aec-938d-764c45085cd8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvkqpn" Jul 30 13:10:04.050988 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:10:04.050934 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/94a17c8b-a4ef-4aec-938d-764c45085cd8-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvkqpn\" (UID: \"94a17c8b-a4ef-4aec-938d-764c45085cd8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvkqpn" Jul 30 13:10:04.051376 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:10:04.051105 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/94a17c8b-a4ef-4aec-938d-764c45085cd8-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvkqpn\" (UID: \"94a17c8b-a4ef-4aec-938d-764c45085cd8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvkqpn" Jul 30 13:10:04.053854 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:10:04.053827 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/94a17c8b-a4ef-4aec-938d-764c45085cd8-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvkqpn\" (UID: \"94a17c8b-a4ef-4aec-938d-764c45085cd8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvkqpn" Jul 30 13:10:04.054195 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:10:04.054169 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/94a17c8b-a4ef-4aec-938d-764c45085cd8-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvkqpn\" (UID: \"94a17c8b-a4ef-4aec-938d-764c45085cd8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvkqpn" Jul 30 13:10:04.060428 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:10:04.060393 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pj4f2\" (UniqueName: \"kubernetes.io/projected/94a17c8b-a4ef-4aec-938d-764c45085cd8-kube-api-access-pj4f2\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvkqpn\" (UID: \"94a17c8b-a4ef-4aec-938d-764c45085cd8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvkqpn" Jul 30 13:10:04.160026 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:10:04.159940 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvkqpn" Jul 30 13:10:04.299186 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:10:04.299162 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvkqpn"] Jul 30 13:10:04.301433 ip-10-0-133-230 kubenswrapper[2579]: W0730 13:10:04.301383 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94a17c8b_a4ef_4aec_938d_764c45085cd8.slice/crio-c9e798b2f46f844c620ef9c72d067ea2d1745c57698be380dc31eadfc06c872c WatchSource:0}: Error finding container c9e798b2f46f844c620ef9c72d067ea2d1745c57698be380dc31eadfc06c872c: Status 404 returned error can't find the container with id c9e798b2f46f844c620ef9c72d067ea2d1745c57698be380dc31eadfc06c872c Jul 30 13:10:04.885251 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:10:04.885215 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvkqpn" event={"ID":"94a17c8b-a4ef-4aec-938d-764c45085cd8","Type":"ContainerStarted","Data":"c9e798b2f46f844c620ef9c72d067ea2d1745c57698be380dc31eadfc06c872c"} Jul 30 13:10:05.891702 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:10:05.891670 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvkqpn" event={"ID":"94a17c8b-a4ef-4aec-938d-764c45085cd8","Type":"ContainerStarted","Data":"a7eef044ee1c17f461c44e51e10b979a1759ececd53fa5252f8b98c5b09ad1d5"} Jul 30 13:10:05.913170 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:10:05.913121 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvkqpn" podStartSLOduration=1.9175842680000001 podStartE2EDuration="2.913105797s" totalImagesPullingTime="995.521529ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:10:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:10:05.910224056 +0000 UTC m=+653.741690180" watchObservedRunningTime="2026-07-30 13:10:05.913105797 +0000 UTC m=+653.744571922" Jul 30 13:10:10.087738 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:10:10.087699 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:10:10.740327 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:10:10.740293 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-2wkfv"] Jul 30 13:10:10.749571 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:10:10.749540 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2wkfv" Jul 30 13:10:10.752500 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:10:10.752471 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 30 13:10:10.755317 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:10:10.755291 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-2wkfv"] Jul 30 13:10:10.915380 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:10:10.915347 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6fvq\" (UniqueName: \"kubernetes.io/projected/efcc897e-13fd-4d1b-b144-9de37adeeecb-kube-api-access-j6fvq\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2wkfv\" (UID: \"efcc897e-13fd-4d1b-b144-9de37adeeecb\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2wkfv" Jul 30 13:10:10.915380 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:10:10.915382 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/efcc897e-13fd-4d1b-b144-9de37adeeecb-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2wkfv\" (UID: \"efcc897e-13fd-4d1b-b144-9de37adeeecb\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2wkfv" Jul 30 13:10:10.915621 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:10:10.915482 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/efcc897e-13fd-4d1b-b144-9de37adeeecb-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2wkfv\" (UID: \"efcc897e-13fd-4d1b-b144-9de37adeeecb\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2wkfv" Jul 30 13:10:10.915621 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:10:10.915517 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/efcc897e-13fd-4d1b-b144-9de37adeeecb-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2wkfv\" (UID: \"efcc897e-13fd-4d1b-b144-9de37adeeecb\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2wkfv" Jul 30 13:10:10.915621 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:10:10.915533 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/efcc897e-13fd-4d1b-b144-9de37adeeecb-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2wkfv\" (UID: \"efcc897e-13fd-4d1b-b144-9de37adeeecb\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2wkfv" Jul 30 13:10:10.915621 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:10:10.915551 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/efcc897e-13fd-4d1b-b144-9de37adeeecb-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2wkfv\" (UID: \"efcc897e-13fd-4d1b-b144-9de37adeeecb\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2wkfv" Jul 30 13:10:11.016478 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:10:11.016349 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/efcc897e-13fd-4d1b-b144-9de37adeeecb-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2wkfv\" (UID: \"efcc897e-13fd-4d1b-b144-9de37adeeecb\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2wkfv" Jul 30 13:10:11.016478 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:10:11.016395 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/efcc897e-13fd-4d1b-b144-9de37adeeecb-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2wkfv\" (UID: \"efcc897e-13fd-4d1b-b144-9de37adeeecb\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2wkfv" Jul 30 13:10:11.016478 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:10:11.016448 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/efcc897e-13fd-4d1b-b144-9de37adeeecb-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2wkfv\" (UID: \"efcc897e-13fd-4d1b-b144-9de37adeeecb\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2wkfv" Jul 30 13:10:11.016478 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:10:11.016467 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/efcc897e-13fd-4d1b-b144-9de37adeeecb-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2wkfv\" (UID: \"efcc897e-13fd-4d1b-b144-9de37adeeecb\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2wkfv" Jul 30 13:10:11.016776 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:10:11.016638 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6fvq\" (UniqueName: \"kubernetes.io/projected/efcc897e-13fd-4d1b-b144-9de37adeeecb-kube-api-access-j6fvq\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2wkfv\" (UID: \"efcc897e-13fd-4d1b-b144-9de37adeeecb\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2wkfv" Jul 30 13:10:11.016776 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:10:11.016683 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/efcc897e-13fd-4d1b-b144-9de37adeeecb-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2wkfv\" (UID: \"efcc897e-13fd-4d1b-b144-9de37adeeecb\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2wkfv" Jul 30 13:10:11.016878 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:10:11.016802 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/efcc897e-13fd-4d1b-b144-9de37adeeecb-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2wkfv\" (UID: \"efcc897e-13fd-4d1b-b144-9de37adeeecb\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2wkfv" Jul 30 13:10:11.016878 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:10:11.016854 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/efcc897e-13fd-4d1b-b144-9de37adeeecb-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2wkfv\" (UID: \"efcc897e-13fd-4d1b-b144-9de37adeeecb\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2wkfv" Jul 30 13:10:11.017017 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:10:11.016999 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/efcc897e-13fd-4d1b-b144-9de37adeeecb-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2wkfv\" (UID: \"efcc897e-13fd-4d1b-b144-9de37adeeecb\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2wkfv" Jul 30 13:10:11.018741 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:10:11.018716 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/efcc897e-13fd-4d1b-b144-9de37adeeecb-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2wkfv\" (UID: \"efcc897e-13fd-4d1b-b144-9de37adeeecb\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2wkfv" Jul 30 13:10:11.018873 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:10:11.018857 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/efcc897e-13fd-4d1b-b144-9de37adeeecb-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2wkfv\" (UID: \"efcc897e-13fd-4d1b-b144-9de37adeeecb\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2wkfv" Jul 30 13:10:11.026615 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:10:11.026590 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6fvq\" (UniqueName: \"kubernetes.io/projected/efcc897e-13fd-4d1b-b144-9de37adeeecb-kube-api-access-j6fvq\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2wkfv\" (UID: \"efcc897e-13fd-4d1b-b144-9de37adeeecb\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2wkfv" Jul 30 13:10:11.061597 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:10:11.061569 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2wkfv" Jul 30 13:10:11.207491 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:10:11.207462 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-2wkfv"] Jul 30 13:10:11.208763 ip-10-0-133-230 kubenswrapper[2579]: W0730 13:10:11.208738 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefcc897e_13fd_4d1b_b144_9de37adeeecb.slice/crio-33af86ed95fe32a7ad956563cbc7704b23ed106cbbfb6cc3fc0f26a4c05035f4 WatchSource:0}: Error finding container 33af86ed95fe32a7ad956563cbc7704b23ed106cbbfb6cc3fc0f26a4c05035f4: Status 404 returned error can't find the container with id 33af86ed95fe32a7ad956563cbc7704b23ed106cbbfb6cc3fc0f26a4c05035f4 Jul 30 13:10:11.926509 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:10:11.926452 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2wkfv" event={"ID":"efcc897e-13fd-4d1b-b144-9de37adeeecb","Type":"ContainerStarted","Data":"d59da667f838f10ec0b372629ba4d66429c9c99de3168706995189d156701118"} Jul 30 13:10:11.926704 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:10:11.926526 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2wkfv" event={"ID":"efcc897e-13fd-4d1b-b144-9de37adeeecb","Type":"ContainerStarted","Data":"33af86ed95fe32a7ad956563cbc7704b23ed106cbbfb6cc3fc0f26a4c05035f4"} Jul 30 13:10:11.945315 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:10:11.945253 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2wkfv" podStartSLOduration=1.705597485 podStartE2EDuration="1.945234267s" totalImagesPullingTime="239.636782ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:10:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:10:11.944931513 +0000 UTC m=+659.776397639" watchObservedRunningTime="2026-07-30 13:10:11.945234267 +0000 UTC m=+659.776700396" Jul 30 13:10:11.990747 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:10:11.990701 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:10:14.160932 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:10:14.160896 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvkqpn" Jul 30 13:10:14.161507 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:10:14.160961 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvkqpn" Jul 30 13:10:14.173503 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:10:14.173478 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvkqpn" Jul 30 13:10:14.956223 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:10:14.956191 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvkqpn" Jul 30 13:10:18.586636 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:10:18.586599 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:10:21.061999 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:10:21.061965 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2wkfv" Jul 30 13:10:21.062394 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:10:21.062027 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2wkfv" Jul 30 13:10:21.074652 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:10:21.074621 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2wkfv" Jul 30 13:10:22.001717 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:10:22.001692 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2wkfv" Jul 30 13:11:45.253718 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:11:45.253672 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:11:45.347429 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:11:45.347384 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:11:46.424858 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:11:46.424812 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:11:46.522442 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:11:46.522373 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:12:06.714078 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:12:06.714046 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:12:06.769591 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:12:06.769548 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:13:52.173940 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:13:52.173889 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:13:53.368156 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:13:53.368112 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:13:59.153844 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:13:59.153798 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:13:59.886198 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:13:59.886148 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:13:59.986743 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:13:59.986708 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:14:10.470647 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:14:10.470548 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:15:10.718653 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:15:10.718616 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:15:10.814182 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:15:10.814128 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:15:10.949232 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:15:10.949198 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:15:16.638648 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:15:16.638607 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:15:17.849253 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:15:17.849217 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:15:22.697007 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:15:22.696968 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:15:22.759872 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:15:22.759837 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:17:56.607993 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:17:56.607956 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:19:30.510090 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:19:30.510044 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:19:30.563617 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:19:30.563584 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:21:21.073103 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:21:21.073060 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:22:39.017606 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:22:39.017562 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:23:36.493917 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:23:36.493872 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:24:00.970046 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:24:00.970013 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:25:30.933032 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:25:30.932993 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:25:39.990114 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:25:39.990085 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:25:46.009851 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:25:46.009818 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:26:10.751832 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:26:10.751800 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:26:12.760186 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:26:12.760152 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:29:20.506634 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:29:20.506602 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:30:15.575383 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:30:15.575347 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:30:52.063722 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:30:52.063627 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:30:55.547157 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:30:55.547123 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:30:55.644035 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:30:55.643973 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:30:56.094743 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:30:56.094708 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:31:02.557213 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:31:02.557176 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:31:02.657745 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:31:02.657705 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:31:02.814508 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:31:02.814399 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:31:03.268118 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:31:03.268084 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:31:03.464039 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:31:03.464007 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:31:09.748587 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:31:09.748551 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:31:09.842960 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:31:09.842920 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:31:11.007710 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:31:11.007680 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:31:11.293429 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:31:11.293323 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:31:11.487929 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:31:11.487892 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:31:11.591016 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:31:11.590929 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:31:41.612045 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:31:41.612008 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:31:41.715682 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:31:41.715646 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:31:41.938538 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:31:41.938452 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:31:42.038936 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:31:42.038898 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:31:42.131920 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:31:42.131890 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:31:42.319479 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:31:42.319445 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:31:42.561025 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:31:42.560993 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:31:42.661482 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:31:42.661384 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:31:42.810746 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:31:42.810716 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:31:43.244855 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:31:43.244819 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:31:43.390255 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:31:43.390221 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:31:46.149027 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:31:46.148992 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:31:46.379393 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:31:46.379360 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:31:46.684614 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:31:46.684575 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:31:46.822750 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:31:46.822713 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:31:46.924027 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:31:46.923991 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:32:16.955218 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:32:16.955180 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:32:17.051451 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:32:17.051394 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:32:17.205959 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:32:17.205879 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:32:17.308632 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:32:17.308599 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:32:17.449899 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:32:17.449862 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:32:17.671977 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:32:17.671891 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:32:17.944959 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:32:17.944875 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:32:18.347889 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:32:18.347852 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:32:18.642914 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:32:18.642805 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:32:21.053189 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:32:21.053142 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:32:21.214994 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:32:21.214952 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:32:22.320937 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:32:22.320903 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:32:22.577553 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:32:22.577462 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:32:22.761538 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:32:22.761506 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:32:22.857790 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:32:22.857696 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:32:52.775040 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:32:52.774997 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:32:52.874584 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:32:52.874552 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:32:52.979602 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:32:52.979562 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:32:53.056118 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:32:53.056013 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:32:54.258869 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:32:54.258825 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:32:54.474510 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:32:54.474466 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:32:54.732558 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:32:54.732528 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:32:55.053110 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:32:55.053024 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:32:55.168460 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:32:55.168398 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:32:57.384030 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:32:57.383994 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:32:57.466720 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:32:57.466680 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:32:58.567054 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:32:58.567021 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:32:58.894777 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:32:58.894666 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:32:59.061192 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:32:59.061154 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:32:59.142729 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:32:59.142688 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:33:28.823536 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:33:28.823502 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:33:28.923253 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:33:28.923215 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:33:28.985041 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:33:28.985010 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:33:29.138984 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:33:29.138870 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:33:29.377081 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:33:29.377030 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:33:29.885084 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:33:29.885051 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:33:29.983380 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:33:29.983345 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:33:30.085130 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:33:30.085079 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:33:52.060720 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:33:52.060633 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:33:59.362293 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:33:59.362251 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:33:59.471012 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:33:59.470976 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:33:59.571816 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:33:59.571786 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:33:59.681770 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:33:59.681681 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:34:00.136588 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:34:00.136550 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:34:08.839982 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:34:08.839950 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:34:26.266347 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:34:26.266311 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:34:33.054060 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:34:33.054025 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:34:33.172449 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:34:33.172399 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:34:33.330612 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:34:33.330514 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:34:49.236147 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:34:49.236110 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:34:55.171762 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:34:55.171722 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:34:55.281179 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:34:55.281117 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:34:55.424603 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:34:55.424512 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:35:05.968268 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:35:05.968184 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:35:17.114342 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:35:17.114301 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:35:23.449854 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:35:23.449820 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:35:23.893745 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:35:23.893697 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:35:24.138947 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:35:24.138910 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:35:24.318528 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:35:24.318493 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:35:24.999098 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:35:24.999064 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:35:25.102323 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:35:25.102288 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:35:25.211098 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:35:25.211039 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:35:26.804326 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:35:26.804294 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:35:32.914105 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:35:32.914074 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:35:32.978865 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:35:32.978834 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:35:33.587790 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:35:33.587746 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:35:40.432245 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:35:40.432194 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:35:40.532472 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:35:40.532410 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:35:40.698104 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:35:40.698012 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:35:41.047290 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:35:41.047239 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:35:41.236909 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:35:41.236871 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:35:43.879623 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:35:43.879589 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:35:43.976870 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:35:43.976839 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:35:44.970814 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:35:44.970771 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:35:45.192791 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:35:45.192752 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:35:45.638291 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:35:45.638257 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:35:45.775583 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:35:45.775552 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:36:03.488658 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:36:03.488619 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:36:03.590880 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:36:03.590845 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:36:08.752631 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:36:08.752592 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:36:09.430831 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:36:09.430795 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:36:09.595675 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:36:09.595644 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:36:09.866378 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:36:09.866341 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:36:12.366296 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:36:12.366259 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:36:15.671360 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:36:15.671327 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:36:15.736495 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:36:15.736460 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:36:26.467055 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:36:26.467014 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:36:26.544650 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:36:26.544619 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:36:26.614883 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:36:26.614852 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:36:26.716519 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:36:26.716484 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:36:27.055829 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:36:27.055795 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:36:33.185347 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:36:33.185316 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:36:33.255726 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:36:33.255685 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:36:33.478674 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:36:33.478640 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:36:33.724080 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:36:33.724047 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:36:33.887446 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:36:33.887332 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:36:33.995936 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:36:33.995901 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:36:34.141760 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:36:34.141679 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:36:40.066186 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:36:40.066107 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:36:40.176411 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:36:40.176377 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:36:40.266235 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:36:40.266201 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:36:40.406619 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:36:40.406530 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:36:46.521686 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:36:46.521649 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:36:46.599012 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:36:46.598977 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:38:45.120486 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:38:45.120407 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:38:45.209036 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:38:45.209005 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:38:49.723263 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:38:49.723228 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:38:50.048483 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:38:50.048381 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:38:50.564530 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:38:50.564500 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:38:52.557663 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:38:52.557621 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:38:52.656338 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:38:52.656294 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:38:53.706969 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:38:53.706934 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:38:53.819101 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:38:53.819066 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:38:54.490713 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:38:54.490674 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:38:54.565615 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:38:54.565580 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:39:15.911898 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:39:15.911863 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:39:16.013013 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:39:16.012979 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:39:22.771510 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:39:22.771475 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:39:28.273310 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:39:28.273262 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:40:18.033209 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:40:18.033171 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:40:18.176712 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:40:18.176679 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:40:18.291713 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:40:18.291622 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:40:18.423182 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:40:18.423146 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:40:21.739177 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:40:21.739147 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:40:26.763476 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:40:26.763440 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:41:03.778990 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:41:03.778951 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:41:03.933864 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:41:03.933837 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:41:09.731133 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:41:09.731050 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:41:09.800555 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:41:09.800522 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:41:10.032854 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:41:10.032773 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:41:10.282231 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:41:10.282198 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:41:15.598949 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:41:15.598912 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:41:15.667924 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:41:15.667894 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:41:31.269966 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:41:31.269932 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:41:31.908660 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:41:31.908629 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:41:32.009754 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:41:32.009712 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:41:32.775842 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:41:32.775784 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:41:32.866647 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:41:32.866615 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:41:32.971590 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:41:32.971552 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:41:34.266250 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:41:34.266221 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:41:40.147925 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:41:40.147889 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:41:40.212308 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:41:40.212269 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:41:40.941088 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:41:40.941053 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:41:46.582207 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:41:46.582169 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:41:46.695542 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:41:46.695494 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:41:46.782743 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:41:46.782689 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:41:55.087080 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:41:55.087042 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:41:57.292328 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:41:57.292296 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:41:57.524618 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:41:57.524588 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:42:18.490348 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:42:18.490312 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:42:24.869592 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:42:24.869556 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:42:24.972138 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:42:24.972102 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:42:25.239136 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:42:25.239103 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:42:25.624878 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:42:25.624790 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:42:26.124057 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:42:26.124022 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:42:28.533499 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:42:28.533466 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:42:28.632111 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:42:28.632065 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:42:29.654712 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:42:29.654681 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:42:30.153055 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:42:30.153013 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:42:30.260214 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:42:30.260177 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:42:53.572043 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:42:53.572003 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:42:53.934301 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:42:53.934211 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:42:54.250188 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:42:54.250150 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:42:54.394514 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:42:54.394484 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:42:56.803098 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:42:56.803066 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:42:57.667601 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:42:57.667555 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:42:57.765235 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:42:57.765177 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:42:58.795080 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:42:58.795050 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:42:59.265291 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:42:59.265257 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:42:59.366271 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:42:59.366240 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:42:59.494964 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:42:59.494931 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:43:22.674524 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:43:22.674491 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:43:41.794312 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:43:41.794287 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:43:58.369804 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:43:58.369764 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:44:42.663374 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:44:42.663332 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:44:43.670431 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:44:43.670388 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-628283-2z6hp"] Jul 30 13:44:43.674261 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:44:43.674242 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-628283-2z6hp" Jul 30 13:44:43.677028 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:44:43.677003 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 30 13:44:43.677194 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:44:43.677065 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wxdpz\"" Jul 30 13:44:43.682202 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:44:43.682168 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-628283-2z6hp"] Jul 30 13:44:43.784015 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:44:43.783973 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3825ef9-d274-482e-bd1f-811d3e21ee5a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-628283-2z6hp\" (UID: \"f3825ef9-d274-482e-bd1f-811d3e21ee5a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-628283-2z6hp" Jul 30 13:44:43.885017 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:44:43.884976 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3825ef9-d274-482e-bd1f-811d3e21ee5a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-628283-2z6hp\" (UID: \"f3825ef9-d274-482e-bd1f-811d3e21ee5a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-628283-2z6hp" Jul 30 13:44:43.885692 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:44:43.885675 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3825ef9-d274-482e-bd1f-811d3e21ee5a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-628283-2z6hp\" (UID: \"f3825ef9-d274-482e-bd1f-811d3e21ee5a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-628283-2z6hp" Jul 30 13:44:43.986771 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:44:43.986732 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-628283-2z6hp" Jul 30 13:44:44.130578 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:44:44.130548 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-628283-2z6hp"] Jul 30 13:44:44.132721 ip-10-0-133-230 kubenswrapper[2579]: W0730 13:44:44.132693 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3825ef9_d274_482e_bd1f_811d3e21ee5a.slice/crio-a54d031e162277464b71235424818f7e10fa342420a03cd2b4aa33006466b648 WatchSource:0}: Error finding container a54d031e162277464b71235424818f7e10fa342420a03cd2b4aa33006466b648: Status 404 returned error can't find the container with id a54d031e162277464b71235424818f7e10fa342420a03cd2b4aa33006466b648 Jul 30 13:44:44.134837 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:44:44.134818 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 30 13:44:44.311479 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:44:44.311362 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:44:44.875922 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:44:44.875886 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-628283-2z6hp" event={"ID":"f3825ef9-d274-482e-bd1f-811d3e21ee5a","Type":"ContainerStarted","Data":"a54d031e162277464b71235424818f7e10fa342420a03cd2b4aa33006466b648"} Jul 30 13:44:46.890024 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:44:46.889974 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-628283-2z6hp" event={"ID":"f3825ef9-d274-482e-bd1f-811d3e21ee5a","Type":"ContainerStarted","Data":"174f1f550def9309cc566ba5642320b9cafcbf54c3c81546fddaf61e65b3a0b2"} Jul 30 13:44:46.908682 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:44:46.908624 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-628283-2z6hp" podStartSLOduration=1.464796261 podStartE2EDuration="3.908609891s" totalImagesPullingTime="2.44381363s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:44:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:44:46.906261442 +0000 UTC m=+2734.737727567" watchObservedRunningTime="2026-07-30 13:44:46.908609891 +0000 UTC m=+2734.740076054" Jul 30 13:44:47.897275 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:44:47.897237 2579 generic.go:356] "Generic (PLEG): container finished" podID="f3825ef9-d274-482e-bd1f-811d3e21ee5a" containerID="174f1f550def9309cc566ba5642320b9cafcbf54c3c81546fddaf61e65b3a0b2" exitCode=0 Jul 30 13:44:47.897685 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:44:47.897307 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-628283-2z6hp" event={"ID":"f3825ef9-d274-482e-bd1f-811d3e21ee5a","Type":"ContainerDied","Data":"174f1f550def9309cc566ba5642320b9cafcbf54c3c81546fddaf61e65b3a0b2"} Jul 30 13:44:49.038010 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:44:49.037979 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-628283-2z6hp" Jul 30 13:44:49.141176 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:44:49.141145 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3825ef9-d274-482e-bd1f-811d3e21ee5a-maas-api-service-ca\") pod \"f3825ef9-d274-482e-bd1f-811d3e21ee5a\" (UID: \"f3825ef9-d274-482e-bd1f-811d3e21ee5a\") " Jul 30 13:44:49.141506 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:44:49.141481 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3825ef9-d274-482e-bd1f-811d3e21ee5a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f3825ef9-d274-482e-bd1f-811d3e21ee5a" (UID: "f3825ef9-d274-482e-bd1f-811d3e21ee5a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 13:44:49.241927 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:44:49.241896 2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3825ef9-d274-482e-bd1f-811d3e21ee5a-maas-api-service-ca\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 13:44:49.909250 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:44:49.909221 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-628283-2z6hp" Jul 30 13:44:49.909450 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:44:49.909260 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-628283-2z6hp" event={"ID":"f3825ef9-d274-482e-bd1f-811d3e21ee5a","Type":"ContainerDied","Data":"a54d031e162277464b71235424818f7e10fa342420a03cd2b4aa33006466b648"} Jul 30 13:44:49.909450 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:44:49.909345 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a54d031e162277464b71235424818f7e10fa342420a03cd2b4aa33006466b648" Jul 30 13:44:54.152500 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:44:54.152463 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:44:54.254337 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:44:54.254300 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:44:54.332707 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:44:54.332669 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-628283-2z6hp"] Jul 30 13:44:54.334303 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:44:54.334276 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:44:54.335132 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:44:54.335111 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-628283-2z6hp"] Jul 30 13:44:54.394309 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:44:54.394275 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:44:54.704368 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:44:54.704320 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:44:54.708192 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:44:54.708164 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3825ef9-d274-482e-bd1f-811d3e21ee5a" path="/var/lib/kubelet/pods/f3825ef9-d274-482e-bd1f-811d3e21ee5a/volumes" Jul 30 13:45:00.136981 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:45:00.136945 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-bdee41-29756985-svqtw"] Jul 30 13:45:00.137405 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:45:00.137384 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3825ef9-d274-482e-bd1f-811d3e21ee5a" containerName="revoke-keys" Jul 30 13:45:00.137405 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:45:00.137402 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3825ef9-d274-482e-bd1f-811d3e21ee5a" containerName="revoke-keys" Jul 30 13:45:00.137542 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:45:00.137522 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3825ef9-d274-482e-bd1f-811d3e21ee5a" containerName="revoke-keys" Jul 30 13:45:00.140823 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:45:00.140803 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-bdee41-29756985-svqtw" Jul 30 13:45:00.144071 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:45:00.144052 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wxdpz\"" Jul 30 13:45:00.152185 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:45:00.152162 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-bdee41-29756985-svqtw" Jul 30 13:45:00.152439 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:45:00.152231 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-bdee41-29756985-svqtw"] Jul 30 13:45:00.296445 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:45:00.296393 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-bdee41-29756985-svqtw"] Jul 30 13:45:00.297968 ip-10-0-133-230 kubenswrapper[2579]: W0730 13:45:00.297931 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d5ec730_7a0d_45db_9d8b_e5d38937583e.slice/crio-4338d939163aaf74fefb682eb6e21920e9e73428c6ad56990db3c3ad41ab490d WatchSource:0}: Error finding container 4338d939163aaf74fefb682eb6e21920e9e73428c6ad56990db3c3ad41ab490d: Status 404 returned error can't find the container with id 4338d939163aaf74fefb682eb6e21920e9e73428c6ad56990db3c3ad41ab490d Jul 30 13:45:00.969820 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:45:00.969784 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-bdee41-29756985-svqtw" event={"ID":"5d5ec730-7a0d-45db-9d8b-e5d38937583e","Type":"ContainerStarted","Data":"57e96b9e8d6a7a3c2bd8daebe880a1d6e2868ef76bdd726eec155bfe90006d5c"} Jul 30 13:45:00.970112 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:45:00.969845 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-bdee41-29756985-svqtw" event={"ID":"5d5ec730-7a0d-45db-9d8b-e5d38937583e","Type":"ContainerStarted","Data":"4338d939163aaf74fefb682eb6e21920e9e73428c6ad56990db3c3ad41ab490d"} Jul 30 13:45:00.986463 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:45:00.986391 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-bdee41-29756985-svqtw" podStartSLOduration=0.986375372 podStartE2EDuration="986.375372ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:45:00.985110892 +0000 UTC m=+2748.816577018" watchObservedRunningTime="2026-07-30 13:45:00.986375372 +0000 UTC m=+2748.817841496" Jul 30 13:45:01.151084 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:45:01.151030 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:45:01.218367 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:45:01.218329 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:45:01.449957 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:45:01.449870 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:45:01.670603 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:45:01.670569 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:45:01.979086 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:45:01.979049 2579 generic.go:356] "Generic (PLEG): container finished" podID="5d5ec730-7a0d-45db-9d8b-e5d38937583e" containerID="57e96b9e8d6a7a3c2bd8daebe880a1d6e2868ef76bdd726eec155bfe90006d5c" exitCode=0 Jul 30 13:45:01.979253 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:45:01.979146 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-bdee41-29756985-svqtw" event={"ID":"5d5ec730-7a0d-45db-9d8b-e5d38937583e","Type":"ContainerDied","Data":"57e96b9e8d6a7a3c2bd8daebe880a1d6e2868ef76bdd726eec155bfe90006d5c"} Jul 30 13:45:03.115314 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:45:03.115287 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-bdee41-29756985-svqtw" Jul 30 13:45:03.991784 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:45:03.991757 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-bdee41-29756985-svqtw" Jul 30 13:45:03.991955 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:45:03.991756 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-bdee41-29756985-svqtw" event={"ID":"5d5ec730-7a0d-45db-9d8b-e5d38937583e","Type":"ContainerDied","Data":"4338d939163aaf74fefb682eb6e21920e9e73428c6ad56990db3c3ad41ab490d"} Jul 30 13:45:03.991955 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:45:03.991884 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4338d939163aaf74fefb682eb6e21920e9e73428c6ad56990db3c3ad41ab490d" Jul 30 13:45:12.375976 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:45:12.375938 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:45:12.376436 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:45:12.376093 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-bdee41-29756985-svqtw"] Jul 30 13:45:12.381053 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:45:12.381030 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-bdee41-29756985-svqtw"] Jul 30 13:45:12.475723 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:45:12.475690 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:45:12.588293 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:45:12.588209 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:45:12.713664 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:45:12.713631 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d5ec730-7a0d-45db-9d8b-e5d38937583e" path="/var/lib/kubelet/pods/5d5ec730-7a0d-45db-9d8b-e5d38937583e/volumes" Jul 30 13:45:12.775289 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:45:12.775260 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:45:12.942324 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:45:12.942291 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:45:18.771575 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:45:18.771537 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:45:18.869252 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:45:18.869215 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:45:19.051231 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:45:19.051139 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:45:19.278858 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:45:19.278823 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:45:19.630887 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:45:19.630850 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:45:19.966067 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:45:19.966034 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:45:20.060025 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:45:20.059994 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:45:22.471676 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:45:22.471640 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:45:22.571506 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:45:22.571471 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:45:23.543218 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:45:23.543178 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:45:23.694728 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:45:23.694693 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:45:24.124566 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:45:24.124534 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:45:24.228305 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:45:24.228273 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:45:32.822158 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:45:32.822106 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:45:32.922994 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:45:32.922960 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:45:47.479104 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:45:47.479067 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:45:47.985376 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:45:47.985334 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:45:48.314849 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:45:48.314769 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:45:48.470882 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:45:48.470848 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:45:51.562471 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:45:51.562405 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:45:51.658472 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:45:51.658409 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:45:52.686707 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:45:52.686669 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:45:52.969554 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:45:52.969521 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:45:53.178691 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:45:53.178650 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:45:53.302679 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:45:53.302592 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:46:16.583950 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:46:16.583915 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:46:19.478663 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:46:19.478630 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-45e018-9x7q9"] Jul 30 13:46:19.479193 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:46:19.479014 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d5ec730-7a0d-45db-9d8b-e5d38937583e" containerName="cleanup" Jul 30 13:46:19.479193 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:46:19.479026 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d5ec730-7a0d-45db-9d8b-e5d38937583e" containerName="cleanup" Jul 30 13:46:19.479193 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:46:19.479088 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d5ec730-7a0d-45db-9d8b-e5d38937583e" containerName="cleanup" Jul 30 13:46:19.482202 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:46:19.482186 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-45e018-9x7q9" Jul 30 13:46:19.485332 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:46:19.485309 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 30 13:46:19.485332 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:46:19.485330 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wxdpz\"" Jul 30 13:46:19.490702 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:46:19.490678 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-45e018-9x7q9"] Jul 30 13:46:19.593142 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:46:19.593112 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc213dd1-b21a-4186-9518-d7ec0f0ede45-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-45e018-9x7q9\" (UID: \"dc213dd1-b21a-4186-9518-d7ec0f0ede45\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-45e018-9x7q9" Jul 30 13:46:19.694517 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:46:19.694408 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc213dd1-b21a-4186-9518-d7ec0f0ede45-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-45e018-9x7q9\" (UID: \"dc213dd1-b21a-4186-9518-d7ec0f0ede45\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-45e018-9x7q9" Jul 30 13:46:19.695160 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:46:19.695133 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc213dd1-b21a-4186-9518-d7ec0f0ede45-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-45e018-9x7q9\" (UID: \"dc213dd1-b21a-4186-9518-d7ec0f0ede45\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-45e018-9x7q9" Jul 30 13:46:19.794040 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:46:19.793951 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-45e018-9x7q9" Jul 30 13:46:19.938350 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:46:19.938321 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-45e018-9x7q9"] Jul 30 13:46:19.940404 ip-10-0-133-230 kubenswrapper[2579]: W0730 13:46:19.940375 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc213dd1_b21a_4186_9518_d7ec0f0ede45.slice/crio-0f97606f30abf07c3832a8efedaf2c8324e8e741e762abfc4e155dbd929de542 WatchSource:0}: Error finding container 0f97606f30abf07c3832a8efedaf2c8324e8e741e762abfc4e155dbd929de542: Status 404 returned error can't find the container with id 0f97606f30abf07c3832a8efedaf2c8324e8e741e762abfc4e155dbd929de542 Jul 30 13:46:20.402612 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:46:20.402574 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-45e018-9x7q9" event={"ID":"dc213dd1-b21a-4186-9518-d7ec0f0ede45","Type":"ContainerStarted","Data":"2ed49ec52a7cbf4c5ae07d66fc07bbfe309de1bede0a88486e1a32965553d0f0"} Jul 30 13:46:20.402826 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:46:20.402639 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-45e018-9x7q9" event={"ID":"dc213dd1-b21a-4186-9518-d7ec0f0ede45","Type":"ContainerStarted","Data":"0f97606f30abf07c3832a8efedaf2c8324e8e741e762abfc4e155dbd929de542"} Jul 30 13:46:20.419684 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:46:20.419569 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-45e018-9x7q9" podStartSLOduration=1.41955371 podStartE2EDuration="1.41955371s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:46:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:46:20.417078019 +0000 UTC m=+2828.248544145" watchObservedRunningTime="2026-07-30 13:46:20.41955371 +0000 UTC m=+2828.251019926" Jul 30 13:46:21.409075 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:46:21.409040 2579 generic.go:356] "Generic (PLEG): container finished" podID="dc213dd1-b21a-4186-9518-d7ec0f0ede45" containerID="2ed49ec52a7cbf4c5ae07d66fc07bbfe309de1bede0a88486e1a32965553d0f0" exitCode=0 Jul 30 13:46:21.409075 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:46:21.409078 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-45e018-9x7q9" event={"ID":"dc213dd1-b21a-4186-9518-d7ec0f0ede45","Type":"ContainerDied","Data":"2ed49ec52a7cbf4c5ae07d66fc07bbfe309de1bede0a88486e1a32965553d0f0"} Jul 30 13:46:22.556932 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:46:22.556908 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-45e018-9x7q9" Jul 30 13:46:22.721192 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:46:22.721165 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc213dd1-b21a-4186-9518-d7ec0f0ede45-maas-api-service-ca\") pod \"dc213dd1-b21a-4186-9518-d7ec0f0ede45\" (UID: \"dc213dd1-b21a-4186-9518-d7ec0f0ede45\") " Jul 30 13:46:22.721606 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:46:22.721585 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc213dd1-b21a-4186-9518-d7ec0f0ede45-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "dc213dd1-b21a-4186-9518-d7ec0f0ede45" (UID: "dc213dd1-b21a-4186-9518-d7ec0f0ede45"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 13:46:22.822716 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:46:22.822679 2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc213dd1-b21a-4186-9518-d7ec0f0ede45-maas-api-service-ca\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 13:46:23.421451 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:46:23.421396 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-45e018-9x7q9" event={"ID":"dc213dd1-b21a-4186-9518-d7ec0f0ede45","Type":"ContainerDied","Data":"0f97606f30abf07c3832a8efedaf2c8324e8e741e762abfc4e155dbd929de542"} Jul 30 13:46:23.421451 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:46:23.421444 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-45e018-9x7q9" Jul 30 13:46:23.421678 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:46:23.421473 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0f97606f30abf07c3832a8efedaf2c8324e8e741e762abfc4e155dbd929de542" Jul 30 13:46:35.046441 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:46:35.046389 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:46:35.146744 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:46:35.146712 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:46:35.213262 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:46:35.213217 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-45e018-9x7q9"] Jul 30 13:46:35.217872 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:46:35.217845 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:46:35.218528 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:46:35.218510 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-45e018-9x7q9"] Jul 30 13:46:35.280752 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:46:35.280718 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:46:35.594136 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:46:35.594109 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:46:36.707613 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:46:36.707572 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc213dd1-b21a-4186-9518-d7ec0f0ede45" path="/var/lib/kubelet/pods/dc213dd1-b21a-4186-9518-d7ec0f0ede45/volumes" Jul 30 13:46:41.325643 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:46:41.325604 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:46:41.390462 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:46:41.390405 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:46:41.598577 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:46:41.598492 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:46:41.815491 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:46:41.815380 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:46:41.930197 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:46:41.930111 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5fdbfb-7sp45"] Jul 30 13:46:41.930515 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:46:41.930501 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc213dd1-b21a-4186-9518-d7ec0f0ede45" containerName="revoke-keys" Jul 30 13:46:41.930574 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:46:41.930516 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc213dd1-b21a-4186-9518-d7ec0f0ede45" containerName="revoke-keys" Jul 30 13:46:41.930612 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:46:41.930597 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc213dd1-b21a-4186-9518-d7ec0f0ede45" containerName="revoke-keys" Jul 30 13:46:41.933745 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:46:41.933724 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5fdbfb-7sp45" Jul 30 13:46:41.936299 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:46:41.936271 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 30 13:46:41.936556 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:46:41.936539 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wxdpz\"" Jul 30 13:46:41.942115 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:46:41.941623 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5fdbfb-7sp45"] Jul 30 13:46:42.003316 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:46:42.003282 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d254f875-71da-4bb6-91e9-2b09e0b804ea-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-5fdbfb-7sp45\" (UID: \"d254f875-71da-4bb6-91e9-2b09e0b804ea\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5fdbfb-7sp45" Jul 30 13:46:42.104655 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:46:42.104621 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d254f875-71da-4bb6-91e9-2b09e0b804ea-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-5fdbfb-7sp45\" (UID: \"d254f875-71da-4bb6-91e9-2b09e0b804ea\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5fdbfb-7sp45" Jul 30 13:46:42.105232 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:46:42.105213 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d254f875-71da-4bb6-91e9-2b09e0b804ea-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-5fdbfb-7sp45\" (UID: \"d254f875-71da-4bb6-91e9-2b09e0b804ea\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5fdbfb-7sp45" Jul 30 13:46:42.245556 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:46:42.245525 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5fdbfb-7sp45" Jul 30 13:46:42.385979 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:46:42.385950 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5fdbfb-7sp45"] Jul 30 13:46:42.387842 ip-10-0-133-230 kubenswrapper[2579]: W0730 13:46:42.387813 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd254f875_71da_4bb6_91e9_2b09e0b804ea.slice/crio-2acde5b30b232cd4fd231a0e82477b7c445ba5edaaf819763a456fa2fa2adcf2 WatchSource:0}: Error finding container 2acde5b30b232cd4fd231a0e82477b7c445ba5edaaf819763a456fa2fa2adcf2: Status 404 returned error can't find the container with id 2acde5b30b232cd4fd231a0e82477b7c445ba5edaaf819763a456fa2fa2adcf2 Jul 30 13:46:42.523137 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:46:42.523045 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5fdbfb-7sp45" event={"ID":"d254f875-71da-4bb6-91e9-2b09e0b804ea","Type":"ContainerStarted","Data":"2acde5b30b232cd4fd231a0e82477b7c445ba5edaaf819763a456fa2fa2adcf2"} Jul 30 13:46:43.529641 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:46:43.529609 2579 generic.go:356] "Generic (PLEG): container finished" podID="d254f875-71da-4bb6-91e9-2b09e0b804ea" containerID="b0c802ca5959ce1fadb49f40d840c35af2634b7da801416ac28bcd1350f8fe39" exitCode=0 Jul 30 13:46:43.530040 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:46:43.529705 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5fdbfb-7sp45" event={"ID":"d254f875-71da-4bb6-91e9-2b09e0b804ea","Type":"ContainerDied","Data":"b0c802ca5959ce1fadb49f40d840c35af2634b7da801416ac28bcd1350f8fe39"} Jul 30 13:46:44.679367 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:46:44.679342 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5fdbfb-7sp45" Jul 30 13:46:44.729410 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:46:44.729384 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d254f875-71da-4bb6-91e9-2b09e0b804ea-maas-api-service-ca\") pod \"d254f875-71da-4bb6-91e9-2b09e0b804ea\" (UID: \"d254f875-71da-4bb6-91e9-2b09e0b804ea\") " Jul 30 13:46:44.729764 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:46:44.729737 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d254f875-71da-4bb6-91e9-2b09e0b804ea-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d254f875-71da-4bb6-91e9-2b09e0b804ea" (UID: "d254f875-71da-4bb6-91e9-2b09e0b804ea"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 13:46:44.830819 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:46:44.830722 2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d254f875-71da-4bb6-91e9-2b09e0b804ea-maas-api-service-ca\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 13:46:45.542188 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:46:45.542158 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5fdbfb-7sp45" Jul 30 13:46:45.542188 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:46:45.542181 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5fdbfb-7sp45" event={"ID":"d254f875-71da-4bb6-91e9-2b09e0b804ea","Type":"ContainerDied","Data":"2acde5b30b232cd4fd231a0e82477b7c445ba5edaaf819763a456fa2fa2adcf2"} Jul 30 13:46:45.542408 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:46:45.542227 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2acde5b30b232cd4fd231a0e82477b7c445ba5edaaf819763a456fa2fa2adcf2" Jul 30 13:46:57.599988 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:46:57.599942 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:46:57.674596 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:46:57.674561 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:46:57.737296 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:46:57.737261 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:46:57.769545 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:46:57.769513 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5fdbfb-7sp45"] Jul 30 13:46:57.771676 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:46:57.771656 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5fdbfb-7sp45"] Jul 30 13:46:57.837969 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:46:57.837937 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:46:58.160108 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:46:58.160074 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:46:58.707682 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:46:58.707649 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d254f875-71da-4bb6-91e9-2b09e0b804ea" path="/var/lib/kubelet/pods/d254f875-71da-4bb6-91e9-2b09e0b804ea/volumes" Jul 30 13:47:04.170562 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:47:04.170523 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:47:04.278944 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:47:04.278904 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:47:04.448314 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:47:04.448231 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:47:04.645508 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:47:04.645477 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:47:04.988128 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:47:04.988053 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:47:05.315215 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:47:05.315131 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:47:05.543528 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:47:05.543496 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:47:07.975605 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:47:07.975570 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:47:08.065001 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:47:08.064967 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:47:09.091271 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:47:09.091233 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:47:09.504741 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:47:09.504709 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:47:09.646145 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:47:09.646106 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:47:09.711268 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:47:09.711239 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:47:32.900434 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:47:32.900377 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:47:33.228134 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:47:33.228096 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:47:33.645933 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:47:33.645837 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:47:33.953120 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:47:33.953085 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:47:36.192255 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:47:36.192220 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:47:36.276026 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:47:36.275991 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:47:37.298738 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:47:37.298706 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:47:37.516542 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:47:37.516505 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:47:37.775585 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:47:37.775550 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:47:37.879221 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:47:37.879187 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:48:01.086047 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:48:01.085990 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:48:11.467351 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:48:11.467297 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:48:34.031025 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:48:34.030988 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:48:44.604472 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:48:44.604399 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:50:50.197525 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:50:50.197480 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:51:08.850359 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:51:08.850320 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:51:08.951842 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:51:08.951808 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:51:12.994279 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:51:12.994248 2579 scope.go:117] "RemoveContainer" containerID="57e96b9e8d6a7a3c2bd8daebe880a1d6e2868ef76bdd726eec155bfe90006d5c" Jul 30 13:51:13.003260 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:51:13.003240 2579 scope.go:117] "RemoveContainer" containerID="174f1f550def9309cc566ba5642320b9cafcbf54c3c81546fddaf61e65b3a0b2" Jul 30 13:51:16.055355 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:51:16.055318 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:51:16.114023 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:51:16.113988 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:51:26.149181 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:51:26.149142 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pkntb"] Jul 30 13:51:26.149636 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:51:26.149518 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d254f875-71da-4bb6-91e9-2b09e0b804ea" containerName="revoke-keys" Jul 30 13:51:26.149636 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:51:26.149530 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d254f875-71da-4bb6-91e9-2b09e0b804ea" containerName="revoke-keys" Jul 30 13:51:26.149636 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:51:26.149605 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d254f875-71da-4bb6-91e9-2b09e0b804ea" containerName="revoke-keys" Jul 30 13:51:26.152994 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:51:26.152976 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-pkntb" Jul 30 13:51:26.155865 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:51:26.155843 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 30 13:51:26.156017 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:51:26.155881 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 30 13:51:26.157171 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:51:26.157149 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-l9shf\"" Jul 30 13:51:26.168884 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:51:26.168852 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pkntb"] Jul 30 13:51:26.277556 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:51:26.277509 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4sf45\" (UniqueName: \"kubernetes.io/projected/9937d478-d201-4dec-8c25-6558df3f3feb-kube-api-access-4sf45\") pod \"kuadrant-operator-catalog-pkntb\" (UID: \"9937d478-d201-4dec-8c25-6558df3f3feb\") " pod="kuadrant-system/kuadrant-operator-catalog-pkntb" Jul 30 13:51:26.378832 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:51:26.378789 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4sf45\" (UniqueName: \"kubernetes.io/projected/9937d478-d201-4dec-8c25-6558df3f3feb-kube-api-access-4sf45\") pod \"kuadrant-operator-catalog-pkntb\" (UID: \"9937d478-d201-4dec-8c25-6558df3f3feb\") " pod="kuadrant-system/kuadrant-operator-catalog-pkntb" Jul 30 13:51:26.388218 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:51:26.388185 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4sf45\" (UniqueName: \"kubernetes.io/projected/9937d478-d201-4dec-8c25-6558df3f3feb-kube-api-access-4sf45\") pod \"kuadrant-operator-catalog-pkntb\" (UID: \"9937d478-d201-4dec-8c25-6558df3f3feb\") " pod="kuadrant-system/kuadrant-operator-catalog-pkntb" Jul 30 13:51:26.462402 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:51:26.462357 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-pkntb" Jul 30 13:51:26.599870 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:51:26.599839 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pkntb"] Jul 30 13:51:26.600743 ip-10-0-133-230 kubenswrapper[2579]: W0730 13:51:26.600710 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9937d478_d201_4dec_8c25_6558df3f3feb.slice/crio-82de4d2794d85369b17dbc4e303f02bcdc2aa97fab37322dd12dfacf4034a4df WatchSource:0}: Error finding container 82de4d2794d85369b17dbc4e303f02bcdc2aa97fab37322dd12dfacf4034a4df: Status 404 returned error can't find the container with id 82de4d2794d85369b17dbc4e303f02bcdc2aa97fab37322dd12dfacf4034a4df Jul 30 13:51:26.602094 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:51:26.602076 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 30 13:51:27.083386 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:51:27.083349 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-pkntb" event={"ID":"9937d478-d201-4dec-8c25-6558df3f3feb","Type":"ContainerStarted","Data":"82de4d2794d85369b17dbc4e303f02bcdc2aa97fab37322dd12dfacf4034a4df"} Jul 30 13:51:29.097697 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:51:29.097656 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-pkntb" event={"ID":"9937d478-d201-4dec-8c25-6558df3f3feb","Type":"ContainerStarted","Data":"0dca8b3d6a2e3c2ce96a1ed57e45f88a2f59d98c0942d125fbafdb72cc23104e"} Jul 30 13:51:29.114833 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:51:29.114761 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-pkntb" podStartSLOduration=0.781512084 podStartE2EDuration="3.114744144s" totalImagesPullingTime="2.33323206s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:51:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:51:29.113146815 +0000 UTC m=+3136.944612964" watchObservedRunningTime="2026-07-30 13:51:29.114744144 +0000 UTC m=+3136.946210314" Jul 30 13:51:34.245927 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:51:34.245887 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:51:36.463144 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:51:36.463109 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-pkntb" Jul 30 13:51:36.463588 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:51:36.463172 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-pkntb" Jul 30 13:51:36.486605 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:51:36.486578 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-pkntb" Jul 30 13:51:37.160216 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:51:37.160185 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-pkntb" Jul 30 13:51:37.195186 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:51:37.195153 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pkntb"] Jul 30 13:51:39.148490 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:51:39.148441 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-pkntb" podUID="9937d478-d201-4dec-8c25-6558df3f3feb" containerName="registry-server" containerID="cri-o://0dca8b3d6a2e3c2ce96a1ed57e45f88a2f59d98c0942d125fbafdb72cc23104e" gracePeriod=2 Jul 30 13:51:39.396582 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:51:39.396555 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-pkntb" Jul 30 13:51:39.493018 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:51:39.492987 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4sf45\" (UniqueName: \"kubernetes.io/projected/9937d478-d201-4dec-8c25-6558df3f3feb-kube-api-access-4sf45\") pod \"9937d478-d201-4dec-8c25-6558df3f3feb\" (UID: \"9937d478-d201-4dec-8c25-6558df3f3feb\") " Jul 30 13:51:39.495073 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:51:39.495049 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9937d478-d201-4dec-8c25-6558df3f3feb-kube-api-access-4sf45" (OuterVolumeSpecName: "kube-api-access-4sf45") pod "9937d478-d201-4dec-8c25-6558df3f3feb" (UID: "9937d478-d201-4dec-8c25-6558df3f3feb"). InnerVolumeSpecName "kube-api-access-4sf45". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 13:51:39.594627 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:51:39.594593 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4sf45\" (UniqueName: \"kubernetes.io/projected/9937d478-d201-4dec-8c25-6558df3f3feb-kube-api-access-4sf45\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 13:51:40.154610 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:51:40.154577 2579 generic.go:356] "Generic (PLEG): container finished" podID="9937d478-d201-4dec-8c25-6558df3f3feb" containerID="0dca8b3d6a2e3c2ce96a1ed57e45f88a2f59d98c0942d125fbafdb72cc23104e" exitCode=0 Jul 30 13:51:40.155219 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:51:40.154628 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-pkntb" Jul 30 13:51:40.155219 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:51:40.154640 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-pkntb" event={"ID":"9937d478-d201-4dec-8c25-6558df3f3feb","Type":"ContainerDied","Data":"0dca8b3d6a2e3c2ce96a1ed57e45f88a2f59d98c0942d125fbafdb72cc23104e"} Jul 30 13:51:40.155219 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:51:40.154680 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-pkntb" event={"ID":"9937d478-d201-4dec-8c25-6558df3f3feb","Type":"ContainerDied","Data":"82de4d2794d85369b17dbc4e303f02bcdc2aa97fab37322dd12dfacf4034a4df"} Jul 30 13:51:40.155219 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:51:40.154699 2579 scope.go:117] "RemoveContainer" containerID="0dca8b3d6a2e3c2ce96a1ed57e45f88a2f59d98c0942d125fbafdb72cc23104e" Jul 30 13:51:40.164710 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:51:40.164688 2579 scope.go:117] "RemoveContainer" containerID="0dca8b3d6a2e3c2ce96a1ed57e45f88a2f59d98c0942d125fbafdb72cc23104e" Jul 30 13:51:40.164958 ip-10-0-133-230 kubenswrapper[2579]: E0730 13:51:40.164939 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0dca8b3d6a2e3c2ce96a1ed57e45f88a2f59d98c0942d125fbafdb72cc23104e\": container with ID starting with 0dca8b3d6a2e3c2ce96a1ed57e45f88a2f59d98c0942d125fbafdb72cc23104e not found: ID does not exist" containerID="0dca8b3d6a2e3c2ce96a1ed57e45f88a2f59d98c0942d125fbafdb72cc23104e" Jul 30 13:51:40.165018 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:51:40.164971 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0dca8b3d6a2e3c2ce96a1ed57e45f88a2f59d98c0942d125fbafdb72cc23104e"} err="failed to get container status \"0dca8b3d6a2e3c2ce96a1ed57e45f88a2f59d98c0942d125fbafdb72cc23104e\": rpc error: code = NotFound desc = could not find container \"0dca8b3d6a2e3c2ce96a1ed57e45f88a2f59d98c0942d125fbafdb72cc23104e\": container with ID starting with 0dca8b3d6a2e3c2ce96a1ed57e45f88a2f59d98c0942d125fbafdb72cc23104e not found: ID does not exist" Jul 30 13:51:40.178689 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:51:40.178663 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pkntb"] Jul 30 13:51:40.182883 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:51:40.182861 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pkntb"] Jul 30 13:51:40.708203 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:51:40.708170 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9937d478-d201-4dec-8c25-6558df3f3feb" path="/var/lib/kubelet/pods/9937d478-d201-4dec-8c25-6558df3f3feb/volumes" Jul 30 13:52:34.732543 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:52:34.732501 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:53:13.042995 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:53:13.042963 2579 scope.go:117] "RemoveContainer" containerID="b0c802ca5959ce1fadb49f40d840c35af2634b7da801416ac28bcd1350f8fe39" Jul 30 13:53:13.051603 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:53:13.051577 2579 scope.go:117] "RemoveContainer" containerID="2ed49ec52a7cbf4c5ae07d66fc07bbfe309de1bede0a88486e1a32965553d0f0" Jul 30 13:53:20.975179 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:53:20.975139 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:53:22.035357 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:53:22.035320 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:53:54.477756 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:53:54.477709 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:54:14.903192 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:54:14.903147 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:56:04.139828 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:56:04.139790 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:56:05.487878 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:56:05.487707 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:56:09.172553 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:56:09.172519 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:56:36.776925 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:56:36.776884 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:56:37.346799 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:56:37.346753 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:58:26.648365 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:58:26.648313 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:58:27.552803 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:58:27.552756 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:58:32.818862 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:58:32.818815 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:58:47.124016 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:58:47.123976 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:58:47.425063 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:58:47.424966 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:58:47.991609 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:58:47.991576 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:58:50.388797 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:58:50.388755 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:58:50.479223 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:58:50.479184 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:58:51.494080 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:58:51.494025 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:58:51.743839 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:58:51.743804 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:58:51.984879 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:58:51.984842 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:58:52.079868 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:58:52.079832 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:58:53.446601 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:58:53.446569 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:58:53.541628 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:58:53.541579 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:59:15.345444 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:59:15.345393 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:59:16.042180 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:59:16.042142 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:59:16.331811 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:59:16.331732 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6"] Jul 30 13:59:16.332131 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:59:16.332118 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9937d478-d201-4dec-8c25-6558df3f3feb" containerName="registry-server" Jul 30 13:59:16.332174 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:59:16.332132 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9937d478-d201-4dec-8c25-6558df3f3feb" containerName="registry-server" Jul 30 13:59:16.332216 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:59:16.332207 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="9937d478-d201-4dec-8c25-6558df3f3feb" containerName="registry-server" Jul 30 13:59:16.335381 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:59:16.335363 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6" Jul 30 13:59:16.340084 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:59:16.340063 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-2a5bef-openshift-default-dockercfg-zd4ps\"" Jul 30 13:59:16.356092 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:59:16.356068 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6"] Jul 30 13:59:16.366674 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:59:16.366650 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:59:16.395175 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:59:16.395142 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bac0cc3e-2d4e-4101-9256-b3424398ff7d-istio-token\") pod \"e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6\" (UID: \"bac0cc3e-2d4e-4101-9256-b3424398ff7d\") " pod="openshift-ingress/e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6" Jul 30 13:59:16.395320 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:59:16.395181 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bac0cc3e-2d4e-4101-9256-b3424398ff7d-istio-data\") pod \"e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6\" (UID: \"bac0cc3e-2d4e-4101-9256-b3424398ff7d\") " pod="openshift-ingress/e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6" Jul 30 13:59:16.395320 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:59:16.395208 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bac0cc3e-2d4e-4101-9256-b3424398ff7d-credential-socket\") pod \"e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6\" (UID: \"bac0cc3e-2d4e-4101-9256-b3424398ff7d\") " pod="openshift-ingress/e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6" Jul 30 13:59:16.395320 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:59:16.395285 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bac0cc3e-2d4e-4101-9256-b3424398ff7d-istio-envoy\") pod \"e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6\" (UID: \"bac0cc3e-2d4e-4101-9256-b3424398ff7d\") " pod="openshift-ingress/e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6" Jul 30 13:59:16.395481 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:59:16.395326 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bac0cc3e-2d4e-4101-9256-b3424398ff7d-istio-podinfo\") pod \"e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6\" (UID: \"bac0cc3e-2d4e-4101-9256-b3424398ff7d\") " pod="openshift-ingress/e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6" Jul 30 13:59:16.395481 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:59:16.395344 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bac0cc3e-2d4e-4101-9256-b3424398ff7d-istiod-ca-cert\") pod \"e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6\" (UID: \"bac0cc3e-2d4e-4101-9256-b3424398ff7d\") " pod="openshift-ingress/e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6" Jul 30 13:59:16.395481 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:59:16.395449 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bac0cc3e-2d4e-4101-9256-b3424398ff7d-workload-certs\") pod \"e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6\" (UID: \"bac0cc3e-2d4e-4101-9256-b3424398ff7d\") " pod="openshift-ingress/e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6" Jul 30 13:59:16.395602 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:59:16.395488 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bac0cc3e-2d4e-4101-9256-b3424398ff7d-workload-socket\") pod \"e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6\" (UID: \"bac0cc3e-2d4e-4101-9256-b3424398ff7d\") " pod="openshift-ingress/e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6" Jul 30 13:59:16.395602 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:59:16.395508 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljzrq\" (UniqueName: \"kubernetes.io/projected/bac0cc3e-2d4e-4101-9256-b3424398ff7d-kube-api-access-ljzrq\") pod \"e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6\" (UID: \"bac0cc3e-2d4e-4101-9256-b3424398ff7d\") " pod="openshift-ingress/e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6" Jul 30 13:59:16.496341 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:59:16.496280 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bac0cc3e-2d4e-4101-9256-b3424398ff7d-istio-token\") pod \"e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6\" (UID: \"bac0cc3e-2d4e-4101-9256-b3424398ff7d\") " pod="openshift-ingress/e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6" Jul 30 13:59:16.496341 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:59:16.496341 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bac0cc3e-2d4e-4101-9256-b3424398ff7d-istio-data\") pod \"e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6\" (UID: \"bac0cc3e-2d4e-4101-9256-b3424398ff7d\") " pod="openshift-ingress/e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6" Jul 30 13:59:16.496594 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:59:16.496538 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bac0cc3e-2d4e-4101-9256-b3424398ff7d-credential-socket\") pod \"e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6\" (UID: \"bac0cc3e-2d4e-4101-9256-b3424398ff7d\") " pod="openshift-ingress/e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6" Jul 30 13:59:16.496633 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:59:16.496602 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bac0cc3e-2d4e-4101-9256-b3424398ff7d-istio-envoy\") pod \"e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6\" (UID: \"bac0cc3e-2d4e-4101-9256-b3424398ff7d\") " pod="openshift-ingress/e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6" Jul 30 13:59:16.496681 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:59:16.496652 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bac0cc3e-2d4e-4101-9256-b3424398ff7d-istio-podinfo\") pod \"e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6\" (UID: \"bac0cc3e-2d4e-4101-9256-b3424398ff7d\") " pod="openshift-ingress/e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6" Jul 30 13:59:16.496681 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:59:16.496675 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bac0cc3e-2d4e-4101-9256-b3424398ff7d-istiod-ca-cert\") pod \"e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6\" (UID: \"bac0cc3e-2d4e-4101-9256-b3424398ff7d\") " pod="openshift-ingress/e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6" Jul 30 13:59:16.496760 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:59:16.496710 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bac0cc3e-2d4e-4101-9256-b3424398ff7d-workload-certs\") pod \"e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6\" (UID: \"bac0cc3e-2d4e-4101-9256-b3424398ff7d\") " pod="openshift-ingress/e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6" Jul 30 13:59:16.496802 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:59:16.496767 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bac0cc3e-2d4e-4101-9256-b3424398ff7d-istio-data\") pod \"e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6\" (UID: \"bac0cc3e-2d4e-4101-9256-b3424398ff7d\") " pod="openshift-ingress/e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6" Jul 30 13:59:16.496802 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:59:16.496768 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bac0cc3e-2d4e-4101-9256-b3424398ff7d-workload-socket\") pod \"e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6\" (UID: \"bac0cc3e-2d4e-4101-9256-b3424398ff7d\") " pod="openshift-ingress/e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6" Jul 30 13:59:16.496899 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:59:16.496811 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljzrq\" (UniqueName: \"kubernetes.io/projected/bac0cc3e-2d4e-4101-9256-b3424398ff7d-kube-api-access-ljzrq\") pod \"e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6\" (UID: \"bac0cc3e-2d4e-4101-9256-b3424398ff7d\") " pod="openshift-ingress/e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6" Jul 30 13:59:16.496899 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:59:16.496882 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bac0cc3e-2d4e-4101-9256-b3424398ff7d-credential-socket\") pod \"e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6\" (UID: \"bac0cc3e-2d4e-4101-9256-b3424398ff7d\") " pod="openshift-ingress/e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6" Jul 30 13:59:16.497055 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:59:16.497025 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bac0cc3e-2d4e-4101-9256-b3424398ff7d-workload-certs\") pod \"e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6\" (UID: \"bac0cc3e-2d4e-4101-9256-b3424398ff7d\") " pod="openshift-ingress/e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6" Jul 30 13:59:16.497190 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:59:16.497169 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bac0cc3e-2d4e-4101-9256-b3424398ff7d-workload-socket\") pod \"e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6\" (UID: \"bac0cc3e-2d4e-4101-9256-b3424398ff7d\") " pod="openshift-ingress/e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6" Jul 30 13:59:16.497626 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:59:16.497601 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bac0cc3e-2d4e-4101-9256-b3424398ff7d-istiod-ca-cert\") pod \"e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6\" (UID: \"bac0cc3e-2d4e-4101-9256-b3424398ff7d\") " pod="openshift-ingress/e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6" Jul 30 13:59:16.499359 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:59:16.499326 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bac0cc3e-2d4e-4101-9256-b3424398ff7d-istio-envoy\") pod \"e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6\" (UID: \"bac0cc3e-2d4e-4101-9256-b3424398ff7d\") " pod="openshift-ingress/e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6" Jul 30 13:59:16.499512 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:59:16.499483 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bac0cc3e-2d4e-4101-9256-b3424398ff7d-istio-podinfo\") pod \"e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6\" (UID: \"bac0cc3e-2d4e-4101-9256-b3424398ff7d\") " pod="openshift-ingress/e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6" Jul 30 13:59:16.507081 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:59:16.507052 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljzrq\" (UniqueName: \"kubernetes.io/projected/bac0cc3e-2d4e-4101-9256-b3424398ff7d-kube-api-access-ljzrq\") pod \"e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6\" (UID: \"bac0cc3e-2d4e-4101-9256-b3424398ff7d\") " pod="openshift-ingress/e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6" Jul 30 13:59:16.509796 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:59:16.509774 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bac0cc3e-2d4e-4101-9256-b3424398ff7d-istio-token\") pod \"e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6\" (UID: \"bac0cc3e-2d4e-4101-9256-b3424398ff7d\") " pod="openshift-ingress/e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6" Jul 30 13:59:16.549050 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:59:16.549016 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:59:16.645491 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:59:16.645389 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6" Jul 30 13:59:16.789029 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:59:16.789003 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6"] Jul 30 13:59:16.791136 ip-10-0-133-230 kubenswrapper[2579]: W0730 13:59:16.791106 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbac0cc3e_2d4e_4101_9256_b3424398ff7d.slice/crio-bfcfdcc81af5a462294a1f54d5b6fb12b9742e2564c68c7594d8f80e54a95045 WatchSource:0}: Error finding container bfcfdcc81af5a462294a1f54d5b6fb12b9742e2564c68c7594d8f80e54a95045: Status 404 returned error can't find the container with id bfcfdcc81af5a462294a1f54d5b6fb12b9742e2564c68c7594d8f80e54a95045 Jul 30 13:59:16.793298 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:59:16.793261 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 30 13:59:16.793382 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:59:16.793336 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 30 13:59:16.793382 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:59:16.793363 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 30 13:59:17.582147 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:59:17.582108 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6" event={"ID":"bac0cc3e-2d4e-4101-9256-b3424398ff7d","Type":"ContainerStarted","Data":"4eb4236c75c83bc139d9b3c87e135db17f0123abcbfd03061832a4371acb4b2b"} Jul 30 13:59:17.582572 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:59:17.582178 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6" event={"ID":"bac0cc3e-2d4e-4101-9256-b3424398ff7d","Type":"ContainerStarted","Data":"bfcfdcc81af5a462294a1f54d5b6fb12b9742e2564c68c7594d8f80e54a95045"} Jul 30 13:59:17.603795 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:59:17.603724 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6" podStartSLOduration=1.603707017 podStartE2EDuration="1.603707017s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 13:59:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 13:59:17.603469907 +0000 UTC m=+3605.434936052" watchObservedRunningTime="2026-07-30 13:59:17.603707017 +0000 UTC m=+3605.435173146" Jul 30 13:59:17.645596 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:59:17.645565 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6" Jul 30 13:59:17.651060 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:59:17.651008 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6" Jul 30 13:59:18.588459 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:59:18.588403 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6" Jul 30 13:59:18.589608 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:59:18.589582 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6" Jul 30 13:59:19.526340 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:59:19.526301 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:59:19.621357 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:59:19.621327 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:59:20.631604 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:59:20.631569 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:59:21.127140 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:59:21.127102 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:59:21.225338 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:59:21.225308 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:59:34.328249 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:59:34.328205 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 13:59:37.702355 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:59:37.702321 2579 generic.go:356] "Generic (PLEG): container finished" podID="bac0cc3e-2d4e-4101-9256-b3424398ff7d" containerID="4eb4236c75c83bc139d9b3c87e135db17f0123abcbfd03061832a4371acb4b2b" exitCode=0 Jul 30 13:59:37.702824 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:59:37.702394 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6" event={"ID":"bac0cc3e-2d4e-4101-9256-b3424398ff7d","Type":"ContainerDied","Data":"4eb4236c75c83bc139d9b3c87e135db17f0123abcbfd03061832a4371acb4b2b"} Jul 30 13:59:37.702871 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:59:37.702830 2579 scope.go:117] "RemoveContainer" containerID="4eb4236c75c83bc139d9b3c87e135db17f0123abcbfd03061832a4371acb4b2b" Jul 30 13:59:37.703927 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:59:37.703897 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 30 13:59:37.704003 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:59:37.703983 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 30 13:59:37.704041 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:59:37.704027 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 30 13:59:38.709956 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:59:38.709921 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6" event={"ID":"bac0cc3e-2d4e-4101-9256-b3424398ff7d","Type":"ContainerStarted","Data":"2ef1f835a6d04c5e81f17501bac3d5fdb35b72374f41bb16ad51f998fc540658"} Jul 30 13:59:39.646820 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:59:39.646770 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6" Jul 30 13:59:39.647232 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:59:39.647204 2579 patch_prober.go:28] interesting pod/e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Jul 30 13:59:39.647409 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:59:39.647380 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6" podUID="bac0cc3e-2d4e-4101-9256-b3424398ff7d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Jul 30 13:59:40.645939 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:59:40.645894 2579 patch_prober.go:28] interesting pod/e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Jul 30 13:59:40.646829 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:59:40.646778 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6" podUID="bac0cc3e-2d4e-4101-9256-b3424398ff7d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Jul 30 13:59:41.646167 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:59:41.646125 2579 patch_prober.go:28] interesting pod/e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Jul 30 13:59:41.646863 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:59:41.646827 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6" podUID="bac0cc3e-2d4e-4101-9256-b3424398ff7d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Jul 30 13:59:42.649475 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:59:42.649443 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6" Jul 30 13:59:42.649954 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:59:42.649708 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6" Jul 30 13:59:42.650571 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:59:42.650552 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6" Jul 30 13:59:51.370064 ip-10-0-133-230 kubenswrapper[2579]: I0730 13:59:51.370026 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 14:00:00.151230 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:00.151190 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e945a1-29757000-zk9j7"] Jul 30 14:00:00.154427 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:00.154397 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29757000-hxs2j"] Jul 30 14:00:00.154548 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:00.154515 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e945a1-29757000-zk9j7" Jul 30 14:00:00.157361 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:00.157329 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wxdpz\"" Jul 30 14:00:00.157748 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:00.157730 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-cd11f9-29757000-7g26t"] Jul 30 14:00:00.157868 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:00.157851 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757000-hxs2j" Jul 30 14:00:00.161077 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:00.161046 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-2a5bef-29757000-85ssq"] Jul 30 14:00:00.161953 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:00.161271 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-cd11f9-29757000-7g26t" Jul 30 14:00:00.165863 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:00.165836 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f4dc0a-29757000-r6bp4"] Jul 30 14:00:00.166622 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:00.166030 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-2a5bef-29757000-85ssq" Jul 30 14:00:00.169745 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:00.169721 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-2a5bef-29757000-85ssq"] Jul 30 14:00:00.169867 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:00.169765 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e945a1-29757000-zk9j7"] Jul 30 14:00:00.169867 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:00.169789 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29757000-hxs2j"] Jul 30 14:00:00.169867 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:00.169814 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f4dc0a-29757000-r6bp4" Jul 30 14:00:00.170265 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:00.170248 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e945a1-29757000-zk9j7" Jul 30 14:00:00.172731 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:00.172702 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-cd11f9-29757000-7g26t"] Jul 30 14:00:00.180315 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:00.180296 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757000-hxs2j" Jul 30 14:00:00.182572 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:00.182547 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f4dc0a-29757000-r6bp4"] Jul 30 14:00:00.219443 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:00.219381 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-cd11f9-29757000-7g26t" Jul 30 14:00:00.227326 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:00.227299 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-2a5bef-29757000-85ssq" Jul 30 14:00:00.267402 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:00.266319 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f4dc0a-29757000-r6bp4" Jul 30 14:00:00.432368 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:00.432339 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-2a5bef-29757000-85ssq"] Jul 30 14:00:00.434521 ip-10-0-133-230 kubenswrapper[2579]: W0730 14:00:00.434482 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e5086c5_2e38_4b90_a3bc_481944d66dbc.slice/crio-6856d5a1101dbffa9bbaccfabb394a64e000f57d56a41d2b661539ec1c90b345 WatchSource:0}: Error finding container 6856d5a1101dbffa9bbaccfabb394a64e000f57d56a41d2b661539ec1c90b345: Status 404 returned error can't find the container with id 6856d5a1101dbffa9bbaccfabb394a64e000f57d56a41d2b661539ec1c90b345 Jul 30 14:00:00.450974 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:00.450948 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-cd11f9-29757000-7g26t"] Jul 30 14:00:00.452330 ip-10-0-133-230 kubenswrapper[2579]: W0730 14:00:00.452305 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb32a5bee_dbd9_4948_9d53_c8a22e332f4e.slice/crio-7ab002335ee8dbcb0039627876dbb426a50634690bc077be86605809f91234c7 WatchSource:0}: Error finding container 7ab002335ee8dbcb0039627876dbb426a50634690bc077be86605809f91234c7: Status 404 returned error can't find the container with id 7ab002335ee8dbcb0039627876dbb426a50634690bc077be86605809f91234c7 Jul 30 14:00:00.476779 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:00.476757 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f4dc0a-29757000-r6bp4"] Jul 30 14:00:00.477366 ip-10-0-133-230 kubenswrapper[2579]: W0730 14:00:00.477343 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod581232ff_aec1_44c6_ab65_29597000a70e.slice/crio-ac80da5380abf9dd8982ccbce4c9ecaf7381b720d0c869086052e5f515a6a105 WatchSource:0}: Error finding container ac80da5380abf9dd8982ccbce4c9ecaf7381b720d0c869086052e5f515a6a105: Status 404 returned error can't find the container with id ac80da5380abf9dd8982ccbce4c9ecaf7381b720d0c869086052e5f515a6a105 Jul 30 14:00:00.562211 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:00.562186 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e945a1-29757000-zk9j7"] Jul 30 14:00:00.563391 ip-10-0-133-230 kubenswrapper[2579]: W0730 14:00:00.563365 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3a0e66e_2e01_4f68_952a_47df7db5c9da.slice/crio-c532c15096581aa4be44d6f46c82dd225141390fded7f51a11e4840790a499d0 WatchSource:0}: Error finding container c532c15096581aa4be44d6f46c82dd225141390fded7f51a11e4840790a499d0: Status 404 returned error can't find the container with id c532c15096581aa4be44d6f46c82dd225141390fded7f51a11e4840790a499d0 Jul 30 14:00:00.604567 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:00.604541 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29757000-hxs2j"] Jul 30 14:00:00.606061 ip-10-0-133-230 kubenswrapper[2579]: W0730 14:00:00.606035 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod717946ba_a60a_415f_af82_076da28b27c0.slice/crio-6e1c10c0d51dcdfcb31f8765455a6091370a7c4ba2dd92944896db06a43fe996 WatchSource:0}: Error finding container 6e1c10c0d51dcdfcb31f8765455a6091370a7c4ba2dd92944896db06a43fe996: Status 404 returned error can't find the container with id 6e1c10c0d51dcdfcb31f8765455a6091370a7c4ba2dd92944896db06a43fe996 Jul 30 14:00:00.827921 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:00.827885 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757000-hxs2j" event={"ID":"717946ba-a60a-415f-af82-076da28b27c0","Type":"ContainerStarted","Data":"6e1c10c0d51dcdfcb31f8765455a6091370a7c4ba2dd92944896db06a43fe996"} Jul 30 14:00:00.829209 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:00.829179 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-cd11f9-29757000-7g26t" event={"ID":"b32a5bee-dbd9-4948-9d53-c8a22e332f4e","Type":"ContainerStarted","Data":"7ab002335ee8dbcb0039627876dbb426a50634690bc077be86605809f91234c7"} Jul 30 14:00:00.830793 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:00.830767 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-2a5bef-29757000-85ssq" event={"ID":"5e5086c5-2e38-4b90-a3bc-481944d66dbc","Type":"ContainerStarted","Data":"d83f6ba03d7f297bb16117beab7e902c20213858c6bd5ece4ac185b2124d3f46"} Jul 30 14:00:00.830908 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:00.830819 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-2a5bef-29757000-85ssq" event={"ID":"5e5086c5-2e38-4b90-a3bc-481944d66dbc","Type":"ContainerStarted","Data":"6856d5a1101dbffa9bbaccfabb394a64e000f57d56a41d2b661539ec1c90b345"} Jul 30 14:00:00.832053 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:00.832031 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f4dc0a-29757000-r6bp4" event={"ID":"581232ff-aec1-44c6-ab65-29597000a70e","Type":"ContainerStarted","Data":"ac80da5380abf9dd8982ccbce4c9ecaf7381b720d0c869086052e5f515a6a105"} Jul 30 14:00:00.833119 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:00.833102 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e945a1-29757000-zk9j7" event={"ID":"f3a0e66e-2e01-4f68-952a-47df7db5c9da","Type":"ContainerStarted","Data":"c532c15096581aa4be44d6f46c82dd225141390fded7f51a11e4840790a499d0"} Jul 30 14:00:00.850353 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:00.850304 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-2a5bef-29757000-85ssq" podStartSLOduration=0.850285594 podStartE2EDuration="850.285594ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 14:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 14:00:00.846941746 +0000 UTC m=+3648.678407871" watchObservedRunningTime="2026-07-30 14:00:00.850285594 +0000 UTC m=+3648.681751717" Jul 30 14:00:01.840262 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:01.840220 2579 generic.go:356] "Generic (PLEG): container finished" podID="5e5086c5-2e38-4b90-a3bc-481944d66dbc" containerID="d83f6ba03d7f297bb16117beab7e902c20213858c6bd5ece4ac185b2124d3f46" exitCode=0 Jul 30 14:00:01.840668 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:01.840313 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-2a5bef-29757000-85ssq" event={"ID":"5e5086c5-2e38-4b90-a3bc-481944d66dbc","Type":"ContainerDied","Data":"d83f6ba03d7f297bb16117beab7e902c20213858c6bd5ece4ac185b2124d3f46"} Jul 30 14:00:01.842000 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:01.841971 2579 generic.go:356] "Generic (PLEG): container finished" podID="581232ff-aec1-44c6-ab65-29597000a70e" containerID="0e8f440a622d72bd588c229251eecd4ebeef8fa9e8a1849a7cbf2054f476ecef" exitCode=0 Jul 30 14:00:01.842160 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:01.842055 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f4dc0a-29757000-r6bp4" event={"ID":"581232ff-aec1-44c6-ab65-29597000a70e","Type":"ContainerDied","Data":"0e8f440a622d72bd588c229251eecd4ebeef8fa9e8a1849a7cbf2054f476ecef"} Jul 30 14:00:01.843599 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:01.843580 2579 generic.go:356] "Generic (PLEG): container finished" podID="f3a0e66e-2e01-4f68-952a-47df7db5c9da" containerID="2e7c69aed21dcd5f431c0586cd0f32f7fa0cc0495dff2828b6a0dbadd31c85d2" exitCode=0 Jul 30 14:00:01.843702 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:01.843605 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e945a1-29757000-zk9j7" event={"ID":"f3a0e66e-2e01-4f68-952a-47df7db5c9da","Type":"ContainerDied","Data":"2e7c69aed21dcd5f431c0586cd0f32f7fa0cc0495dff2828b6a0dbadd31c85d2"} Jul 30 14:00:01.845121 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:01.845096 2579 generic.go:356] "Generic (PLEG): container finished" podID="717946ba-a60a-415f-af82-076da28b27c0" containerID="b5ffbdf9ca4bd889f9b9d8cef03277e17b2075d61febe6fdc584b65fe7e2b06d" exitCode=0 Jul 30 14:00:01.845217 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:01.845141 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757000-hxs2j" event={"ID":"717946ba-a60a-415f-af82-076da28b27c0","Type":"ContainerDied","Data":"b5ffbdf9ca4bd889f9b9d8cef03277e17b2075d61febe6fdc584b65fe7e2b06d"} Jul 30 14:00:01.846558 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:01.846538 2579 generic.go:356] "Generic (PLEG): container finished" podID="b32a5bee-dbd9-4948-9d53-c8a22e332f4e" containerID="f7d2f4616a72c5fa13dd9e4f9c62b2b5bd473ab810966bfec6a9af283bcdefe3" exitCode=0 Jul 30 14:00:01.846645 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:01.846587 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-cd11f9-29757000-7g26t" event={"ID":"b32a5bee-dbd9-4948-9d53-c8a22e332f4e","Type":"ContainerDied","Data":"f7d2f4616a72c5fa13dd9e4f9c62b2b5bd473ab810966bfec6a9af283bcdefe3"} Jul 30 14:00:03.006102 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:03.006073 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-2a5bef-29757000-85ssq" Jul 30 14:00:03.056341 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:03.056317 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f4dc0a-29757000-r6bp4" Jul 30 14:00:03.084528 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:03.084498 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e945a1-29757000-zk9j7" Jul 30 14:00:03.095239 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:03.095215 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757000-hxs2j" Jul 30 14:00:03.099159 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:03.099136 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-cd11f9-29757000-7g26t" Jul 30 14:00:03.859546 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:03.859513 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f4dc0a-29757000-r6bp4" Jul 30 14:00:03.859764 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:03.859513 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f4dc0a-29757000-r6bp4" event={"ID":"581232ff-aec1-44c6-ab65-29597000a70e","Type":"ContainerDied","Data":"ac80da5380abf9dd8982ccbce4c9ecaf7381b720d0c869086052e5f515a6a105"} Jul 30 14:00:03.859764 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:03.859648 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ac80da5380abf9dd8982ccbce4c9ecaf7381b720d0c869086052e5f515a6a105" Jul 30 14:00:03.860944 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:03.860910 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e945a1-29757000-zk9j7" Jul 30 14:00:03.861077 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:03.860936 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e945a1-29757000-zk9j7" event={"ID":"f3a0e66e-2e01-4f68-952a-47df7db5c9da","Type":"ContainerDied","Data":"c532c15096581aa4be44d6f46c82dd225141390fded7f51a11e4840790a499d0"} Jul 30 14:00:03.861077 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:03.860984 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c532c15096581aa4be44d6f46c82dd225141390fded7f51a11e4840790a499d0" Jul 30 14:00:03.862366 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:03.862346 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757000-hxs2j" Jul 30 14:00:03.862366 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:03.862350 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757000-hxs2j" event={"ID":"717946ba-a60a-415f-af82-076da28b27c0","Type":"ContainerDied","Data":"6e1c10c0d51dcdfcb31f8765455a6091370a7c4ba2dd92944896db06a43fe996"} Jul 30 14:00:03.862555 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:03.862388 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6e1c10c0d51dcdfcb31f8765455a6091370a7c4ba2dd92944896db06a43fe996" Jul 30 14:00:03.863665 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:03.863646 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-cd11f9-29757000-7g26t" Jul 30 14:00:03.863765 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:03.863678 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-cd11f9-29757000-7g26t" event={"ID":"b32a5bee-dbd9-4948-9d53-c8a22e332f4e","Type":"ContainerDied","Data":"7ab002335ee8dbcb0039627876dbb426a50634690bc077be86605809f91234c7"} Jul 30 14:00:03.863765 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:03.863713 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7ab002335ee8dbcb0039627876dbb426a50634690bc077be86605809f91234c7" Jul 30 14:00:03.865053 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:03.865035 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-2a5bef-29757000-85ssq" Jul 30 14:00:03.865157 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:03.865035 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-2a5bef-29757000-85ssq" event={"ID":"5e5086c5-2e38-4b90-a3bc-481944d66dbc","Type":"ContainerDied","Data":"6856d5a1101dbffa9bbaccfabb394a64e000f57d56a41d2b661539ec1c90b345"} Jul 30 14:00:03.865230 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:03.865174 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6856d5a1101dbffa9bbaccfabb394a64e000f57d56a41d2b661539ec1c90b345" Jul 30 14:00:39.085521 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:39.085486 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 14:00:39.399050 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:39.398967 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp"] Jul 30 14:00:39.399348 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:39.399335 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b32a5bee-dbd9-4948-9d53-c8a22e332f4e" containerName="cleanup" Jul 30 14:00:39.399397 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:39.399348 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b32a5bee-dbd9-4948-9d53-c8a22e332f4e" containerName="cleanup" Jul 30 14:00:39.399397 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:39.399362 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e5086c5-2e38-4b90-a3bc-481944d66dbc" containerName="cleanup" Jul 30 14:00:39.399397 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:39.399368 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e5086c5-2e38-4b90-a3bc-481944d66dbc" containerName="cleanup" Jul 30 14:00:39.399397 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:39.399374 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3a0e66e-2e01-4f68-952a-47df7db5c9da" containerName="cleanup" Jul 30 14:00:39.399397 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:39.399380 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3a0e66e-2e01-4f68-952a-47df7db5c9da" containerName="cleanup" Jul 30 14:00:39.399397 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:39.399386 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="717946ba-a60a-415f-af82-076da28b27c0" containerName="cleanup" Jul 30 14:00:39.399397 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:39.399391 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="717946ba-a60a-415f-af82-076da28b27c0" containerName="cleanup" Jul 30 14:00:39.399687 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:39.399407 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="581232ff-aec1-44c6-ab65-29597000a70e" containerName="cleanup" Jul 30 14:00:39.399687 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:39.399427 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="581232ff-aec1-44c6-ab65-29597000a70e" containerName="cleanup" Jul 30 14:00:39.399687 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:39.399482 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3a0e66e-2e01-4f68-952a-47df7db5c9da" containerName="cleanup" Jul 30 14:00:39.399687 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:39.399490 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="b32a5bee-dbd9-4948-9d53-c8a22e332f4e" containerName="cleanup" Jul 30 14:00:39.399687 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:39.399499 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e5086c5-2e38-4b90-a3bc-481944d66dbc" containerName="cleanup" Jul 30 14:00:39.399687 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:39.399506 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="581232ff-aec1-44c6-ab65-29597000a70e" containerName="cleanup" Jul 30 14:00:39.399687 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:39.399512 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="717946ba-a60a-415f-af82-076da28b27c0" containerName="cleanup" Jul 30 14:00:39.402876 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:39.402857 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp" Jul 30 14:00:39.405713 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:39.405684 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-0e458a-openshift-default-dockercfg-hwzv2\"" Jul 30 14:00:39.418099 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:39.418061 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp"] Jul 30 14:00:39.444101 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:39.444039 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 14:00:39.543973 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:39.543934 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20d96226-f6a9-4306-9bf2-381e06074ca1-istio-token\") pod \"e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp\" (UID: \"20d96226-f6a9-4306-9bf2-381e06074ca1\") " pod="openshift-ingress/e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp" Jul 30 14:00:39.544202 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:39.543991 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20d96226-f6a9-4306-9bf2-381e06074ca1-credential-socket\") pod \"e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp\" (UID: \"20d96226-f6a9-4306-9bf2-381e06074ca1\") " pod="openshift-ingress/e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp" Jul 30 14:00:39.544202 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:39.544060 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20d96226-f6a9-4306-9bf2-381e06074ca1-workload-socket\") pod \"e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp\" (UID: \"20d96226-f6a9-4306-9bf2-381e06074ca1\") " pod="openshift-ingress/e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp" Jul 30 14:00:39.544202 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:39.544114 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20d96226-f6a9-4306-9bf2-381e06074ca1-istiod-ca-cert\") pod \"e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp\" (UID: \"20d96226-f6a9-4306-9bf2-381e06074ca1\") " pod="openshift-ingress/e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp" Jul 30 14:00:39.544202 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:39.544161 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20d96226-f6a9-4306-9bf2-381e06074ca1-istio-data\") pod \"e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp\" (UID: \"20d96226-f6a9-4306-9bf2-381e06074ca1\") " pod="openshift-ingress/e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp" Jul 30 14:00:39.544344 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:39.544209 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsn74\" (UniqueName: \"kubernetes.io/projected/20d96226-f6a9-4306-9bf2-381e06074ca1-kube-api-access-wsn74\") pod \"e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp\" (UID: \"20d96226-f6a9-4306-9bf2-381e06074ca1\") " pod="openshift-ingress/e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp" Jul 30 14:00:39.544344 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:39.544240 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20d96226-f6a9-4306-9bf2-381e06074ca1-workload-certs\") pod \"e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp\" (UID: \"20d96226-f6a9-4306-9bf2-381e06074ca1\") " pod="openshift-ingress/e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp" Jul 30 14:00:39.544344 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:39.544324 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20d96226-f6a9-4306-9bf2-381e06074ca1-istio-podinfo\") pod \"e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp\" (UID: \"20d96226-f6a9-4306-9bf2-381e06074ca1\") " pod="openshift-ingress/e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp" Jul 30 14:00:39.544492 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:39.544366 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20d96226-f6a9-4306-9bf2-381e06074ca1-istio-envoy\") pod \"e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp\" (UID: \"20d96226-f6a9-4306-9bf2-381e06074ca1\") " pod="openshift-ingress/e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp" Jul 30 14:00:39.645519 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:39.645450 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20d96226-f6a9-4306-9bf2-381e06074ca1-istiod-ca-cert\") pod \"e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp\" (UID: \"20d96226-f6a9-4306-9bf2-381e06074ca1\") " pod="openshift-ingress/e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp" Jul 30 14:00:39.645740 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:39.645572 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20d96226-f6a9-4306-9bf2-381e06074ca1-istio-data\") pod \"e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp\" (UID: \"20d96226-f6a9-4306-9bf2-381e06074ca1\") " pod="openshift-ingress/e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp" Jul 30 14:00:39.645740 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:39.645614 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsn74\" (UniqueName: \"kubernetes.io/projected/20d96226-f6a9-4306-9bf2-381e06074ca1-kube-api-access-wsn74\") pod \"e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp\" (UID: \"20d96226-f6a9-4306-9bf2-381e06074ca1\") " pod="openshift-ingress/e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp" Jul 30 14:00:39.645740 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:39.645657 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20d96226-f6a9-4306-9bf2-381e06074ca1-workload-certs\") pod \"e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp\" (UID: \"20d96226-f6a9-4306-9bf2-381e06074ca1\") " pod="openshift-ingress/e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp" Jul 30 14:00:39.645740 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:39.645699 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20d96226-f6a9-4306-9bf2-381e06074ca1-istio-podinfo\") pod \"e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp\" (UID: \"20d96226-f6a9-4306-9bf2-381e06074ca1\") " pod="openshift-ingress/e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp" Jul 30 14:00:39.645963 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:39.645751 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20d96226-f6a9-4306-9bf2-381e06074ca1-istio-envoy\") pod \"e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp\" (UID: \"20d96226-f6a9-4306-9bf2-381e06074ca1\") " pod="openshift-ingress/e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp" Jul 30 14:00:39.645963 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:39.645810 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20d96226-f6a9-4306-9bf2-381e06074ca1-istio-token\") pod \"e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp\" (UID: \"20d96226-f6a9-4306-9bf2-381e06074ca1\") " pod="openshift-ingress/e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp" Jul 30 14:00:39.646140 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:39.646005 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20d96226-f6a9-4306-9bf2-381e06074ca1-istio-data\") pod \"e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp\" (UID: \"20d96226-f6a9-4306-9bf2-381e06074ca1\") " pod="openshift-ingress/e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp" Jul 30 14:00:39.646140 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:39.646092 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20d96226-f6a9-4306-9bf2-381e06074ca1-credential-socket\") pod \"e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp\" (UID: \"20d96226-f6a9-4306-9bf2-381e06074ca1\") " pod="openshift-ingress/e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp" Jul 30 14:00:39.646140 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:39.646111 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20d96226-f6a9-4306-9bf2-381e06074ca1-workload-certs\") pod \"e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp\" (UID: \"20d96226-f6a9-4306-9bf2-381e06074ca1\") " pod="openshift-ingress/e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp" Jul 30 14:00:39.646140 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:39.646132 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20d96226-f6a9-4306-9bf2-381e06074ca1-workload-socket\") pod \"e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp\" (UID: \"20d96226-f6a9-4306-9bf2-381e06074ca1\") " pod="openshift-ingress/e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp" Jul 30 14:00:39.646351 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:39.646328 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20d96226-f6a9-4306-9bf2-381e06074ca1-istiod-ca-cert\") pod \"e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp\" (UID: \"20d96226-f6a9-4306-9bf2-381e06074ca1\") " pod="openshift-ingress/e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp" Jul 30 14:00:39.646351 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:39.646339 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20d96226-f6a9-4306-9bf2-381e06074ca1-credential-socket\") pod \"e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp\" (UID: \"20d96226-f6a9-4306-9bf2-381e06074ca1\") " pod="openshift-ingress/e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp" Jul 30 14:00:39.646523 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:39.646501 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20d96226-f6a9-4306-9bf2-381e06074ca1-workload-socket\") pod \"e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp\" (UID: \"20d96226-f6a9-4306-9bf2-381e06074ca1\") " pod="openshift-ingress/e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp" Jul 30 14:00:39.648020 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:39.647993 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20d96226-f6a9-4306-9bf2-381e06074ca1-istio-envoy\") pod \"e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp\" (UID: \"20d96226-f6a9-4306-9bf2-381e06074ca1\") " pod="openshift-ingress/e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp" Jul 30 14:00:39.648246 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:39.648226 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20d96226-f6a9-4306-9bf2-381e06074ca1-istio-podinfo\") pod \"e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp\" (UID: \"20d96226-f6a9-4306-9bf2-381e06074ca1\") " pod="openshift-ingress/e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp" Jul 30 14:00:39.653894 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:39.653833 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20d96226-f6a9-4306-9bf2-381e06074ca1-istio-token\") pod \"e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp\" (UID: \"20d96226-f6a9-4306-9bf2-381e06074ca1\") " pod="openshift-ingress/e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp" Jul 30 14:00:39.654032 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:39.654013 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsn74\" (UniqueName: \"kubernetes.io/projected/20d96226-f6a9-4306-9bf2-381e06074ca1-kube-api-access-wsn74\") pod \"e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp\" (UID: \"20d96226-f6a9-4306-9bf2-381e06074ca1\") " pod="openshift-ingress/e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp" Jul 30 14:00:39.713955 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:39.713914 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp" Jul 30 14:00:39.800180 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:39.800149 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 14:00:39.900588 ip-10-0-133-230 kubenswrapper[2579]: W0730 14:00:39.900557 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20d96226_f6a9_4306_9bf2_381e06074ca1.slice/crio-c34fef5aa75e8a6e6bbcaf9bbc5b3f5a261c6a868e83ecb4e8bc786e7a5df795 WatchSource:0}: Error finding container c34fef5aa75e8a6e6bbcaf9bbc5b3f5a261c6a868e83ecb4e8bc786e7a5df795: Status 404 returned error can't find the container with id c34fef5aa75e8a6e6bbcaf9bbc5b3f5a261c6a868e83ecb4e8bc786e7a5df795 Jul 30 14:00:39.903253 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:39.903220 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 30 14:00:39.903363 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:39.903307 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 30 14:00:39.903363 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:39.903352 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 30 14:00:39.906569 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:39.906517 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp"] Jul 30 14:00:40.070011 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:40.069975 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp" event={"ID":"20d96226-f6a9-4306-9bf2-381e06074ca1","Type":"ContainerStarted","Data":"9c4fd819736954cd175f2f70ab6a1ed2d6f413e9635a37794d33374e7b86e765"} Jul 30 14:00:40.070189 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:40.070037 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp" event={"ID":"20d96226-f6a9-4306-9bf2-381e06074ca1","Type":"ContainerStarted","Data":"c34fef5aa75e8a6e6bbcaf9bbc5b3f5a261c6a868e83ecb4e8bc786e7a5df795"} Jul 30 14:00:40.094394 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:40.094335 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp" podStartSLOduration=1.094317941 podStartE2EDuration="1.094317941s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 14:00:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 14:00:40.093456955 +0000 UTC m=+3687.924923103" watchObservedRunningTime="2026-07-30 14:00:40.094317941 +0000 UTC m=+3687.925784153" Jul 30 14:00:40.714272 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:40.714233 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp" Jul 30 14:00:40.720586 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:40.720556 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp" Jul 30 14:00:41.076513 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:41.076429 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp" Jul 30 14:00:41.077294 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:41.077277 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp" Jul 30 14:00:42.058338 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:42.058305 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 14:00:42.513311 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:42.513279 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 14:00:43.428705 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:43.428673 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 14:00:44.006435 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:44.006389 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 14:00:44.089562 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:44.089528 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 14:00:44.331855 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:44.331762 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 14:00:56.762363 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:56.762325 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 14:00:57.461405 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:57.461363 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-0e458a-2mf25"] Jul 30 14:00:57.466696 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:57.466671 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-0e458a-2mf25" Jul 30 14:00:57.470000 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:57.469978 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 30 14:00:57.470138 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:57.470058 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wxdpz\"" Jul 30 14:00:57.477355 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:57.477327 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-0e458a-2mf25"] Jul 30 14:00:57.525361 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:57.525327 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eea79f6c-22b5-4ab4-81d9-ca0edf10567a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-0e458a-2mf25\" (UID: \"eea79f6c-22b5-4ab4-81d9-ca0edf10567a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-0e458a-2mf25" Jul 30 14:00:57.626888 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:57.626841 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eea79f6c-22b5-4ab4-81d9-ca0edf10567a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-0e458a-2mf25\" (UID: \"eea79f6c-22b5-4ab4-81d9-ca0edf10567a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-0e458a-2mf25" Jul 30 14:00:57.627543 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:57.627523 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eea79f6c-22b5-4ab4-81d9-ca0edf10567a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-0e458a-2mf25\" (UID: \"eea79f6c-22b5-4ab4-81d9-ca0edf10567a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-0e458a-2mf25" Jul 30 14:00:57.779489 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:57.779355 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-0e458a-2mf25" Jul 30 14:00:57.938464 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:57.938430 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-0e458a-2mf25"] Jul 30 14:00:57.939770 ip-10-0-133-230 kubenswrapper[2579]: W0730 14:00:57.939741 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeea79f6c_22b5_4ab4_81d9_ca0edf10567a.slice/crio-12d233dd6c343ba974aa9879c499cac95bf7b37509c44be0ab325c4a4d0dfa7f WatchSource:0}: Error finding container 12d233dd6c343ba974aa9879c499cac95bf7b37509c44be0ab325c4a4d0dfa7f: Status 404 returned error can't find the container with id 12d233dd6c343ba974aa9879c499cac95bf7b37509c44be0ab325c4a4d0dfa7f Jul 30 14:00:58.181538 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:58.181505 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-0e458a-2mf25" event={"ID":"eea79f6c-22b5-4ab4-81d9-ca0edf10567a","Type":"ContainerStarted","Data":"12d233dd6c343ba974aa9879c499cac95bf7b37509c44be0ab325c4a4d0dfa7f"} Jul 30 14:00:59.189978 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:59.189871 2579 generic.go:356] "Generic (PLEG): container finished" podID="eea79f6c-22b5-4ab4-81d9-ca0edf10567a" containerID="5f2eb208ad8fae013d1bec6de9918692e60d4b4da5b41cd558e63de40566581d" exitCode=0 Jul 30 14:00:59.190445 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:00:59.189974 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-0e458a-2mf25" event={"ID":"eea79f6c-22b5-4ab4-81d9-ca0edf10567a","Type":"ContainerDied","Data":"5f2eb208ad8fae013d1bec6de9918692e60d4b4da5b41cd558e63de40566581d"} Jul 30 14:01:00.339765 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:00.339737 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-0e458a-2mf25" Jul 30 14:01:00.456696 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:00.456661 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eea79f6c-22b5-4ab4-81d9-ca0edf10567a-maas-api-service-ca\") pod \"eea79f6c-22b5-4ab4-81d9-ca0edf10567a\" (UID: \"eea79f6c-22b5-4ab4-81d9-ca0edf10567a\") " Jul 30 14:01:00.457079 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:00.457050 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eea79f6c-22b5-4ab4-81d9-ca0edf10567a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "eea79f6c-22b5-4ab4-81d9-ca0edf10567a" (UID: "eea79f6c-22b5-4ab4-81d9-ca0edf10567a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 14:01:00.558790 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:00.558749 2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eea79f6c-22b5-4ab4-81d9-ca0edf10567a-maas-api-service-ca\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 14:01:01.206452 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:01.204195 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-0e458a-2mf25" event={"ID":"eea79f6c-22b5-4ab4-81d9-ca0edf10567a","Type":"ContainerDied","Data":"12d233dd6c343ba974aa9879c499cac95bf7b37509c44be0ab325c4a4d0dfa7f"} Jul 30 14:01:01.206452 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:01.204264 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="12d233dd6c343ba974aa9879c499cac95bf7b37509c44be0ab325c4a4d0dfa7f" Jul 30 14:01:01.206452 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:01.204336 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-0e458a-2mf25" Jul 30 14:01:02.211306 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:02.211273 2579 generic.go:356] "Generic (PLEG): container finished" podID="20d96226-f6a9-4306-9bf2-381e06074ca1" containerID="9c4fd819736954cd175f2f70ab6a1ed2d6f413e9635a37794d33374e7b86e765" exitCode=0 Jul 30 14:01:02.211759 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:02.211348 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp" event={"ID":"20d96226-f6a9-4306-9bf2-381e06074ca1","Type":"ContainerDied","Data":"9c4fd819736954cd175f2f70ab6a1ed2d6f413e9635a37794d33374e7b86e765"} Jul 30 14:01:02.211805 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:02.211775 2579 scope.go:117] "RemoveContainer" containerID="9c4fd819736954cd175f2f70ab6a1ed2d6f413e9635a37794d33374e7b86e765" Jul 30 14:01:02.219327 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:02.213502 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 30 14:01:02.219327 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:02.213678 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 30 14:01:02.219327 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:02.213779 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 30 14:01:02.987162 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:02.987130 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 14:01:03.121341 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:03.121302 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 14:01:03.219882 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:03.219846 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp" event={"ID":"20d96226-f6a9-4306-9bf2-381e06074ca1","Type":"ContainerStarted","Data":"7625852e5363477bd64a1a2774a7ec00b893619b629dc76498aef6b4f06b15e8"} Jul 30 14:01:03.307785 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:03.307686 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-0e458a-2mf25"] Jul 30 14:01:03.313224 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:03.313195 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-0e458a-2mf25"] Jul 30 14:01:03.714792 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:03.714756 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp" Jul 30 14:01:03.715003 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:03.714981 2579 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 30 14:01:03.715054 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:03.715029 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp" podUID="20d96226-f6a9-4306-9bf2-381e06074ca1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 30 14:01:03.763156 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:03.763120 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 14:01:03.992687 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:03.992608 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 14:01:04.707502 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:04.707468 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eea79f6c-22b5-4ab4-81d9-ca0edf10567a" path="/var/lib/kubelet/pods/eea79f6c-22b5-4ab4-81d9-ca0edf10567a/volumes" Jul 30 14:01:04.714739 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:04.714714 2579 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 30 14:01:04.714874 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:04.714756 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp" podUID="20d96226-f6a9-4306-9bf2-381e06074ca1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 30 14:01:05.715010 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:05.714973 2579 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 30 14:01:05.715468 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:05.715036 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp" podUID="20d96226-f6a9-4306-9bf2-381e06074ca1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 30 14:01:06.714331 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:06.714296 2579 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 30 14:01:06.714565 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:06.714353 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp" podUID="20d96226-f6a9-4306-9bf2-381e06074ca1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 30 14:01:07.718956 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:07.718923 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp" Jul 30 14:01:07.719529 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:07.719388 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp" Jul 30 14:01:07.720067 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:07.720052 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp" Jul 30 14:01:09.827809 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:09.827772 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 14:01:10.083586 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:10.083505 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp"] Jul 30 14:01:10.263285 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:10.263241 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp" podUID="20d96226-f6a9-4306-9bf2-381e06074ca1" containerName="istio-proxy" containerID="cri-o://7625852e5363477bd64a1a2774a7ec00b893619b629dc76498aef6b4f06b15e8" gracePeriod=30 Jul 30 14:01:13.343054 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:13.343010 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 14:01:13.844730 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:13.844692 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-cd11f9-5jg85"] Jul 30 14:01:13.845074 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:13.845061 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eea79f6c-22b5-4ab4-81d9-ca0edf10567a" containerName="revoke-keys" Jul 30 14:01:13.845125 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:13.845076 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="eea79f6c-22b5-4ab4-81d9-ca0edf10567a" containerName="revoke-keys" Jul 30 14:01:13.845162 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:13.845153 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="eea79f6c-22b5-4ab4-81d9-ca0edf10567a" containerName="revoke-keys" Jul 30 14:01:13.849487 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:13.849465 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-cd11f9-5jg85" Jul 30 14:01:13.852393 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:13.852339 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wxdpz\"" Jul 30 14:01:13.852568 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:13.852341 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 30 14:01:13.857675 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:13.857649 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-cd11f9-5jg85"] Jul 30 14:01:13.991931 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:13.991891 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7e0ede9-f7fb-4a1a-811b-04b254b15202-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-cd11f9-5jg85\" (UID: \"b7e0ede9-f7fb-4a1a-811b-04b254b15202\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-cd11f9-5jg85" Jul 30 14:01:14.093317 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:14.093278 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7e0ede9-f7fb-4a1a-811b-04b254b15202-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-cd11f9-5jg85\" (UID: \"b7e0ede9-f7fb-4a1a-811b-04b254b15202\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-cd11f9-5jg85" Jul 30 14:01:14.093935 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:14.093913 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7e0ede9-f7fb-4a1a-811b-04b254b15202-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-cd11f9-5jg85\" (UID: \"b7e0ede9-f7fb-4a1a-811b-04b254b15202\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-cd11f9-5jg85" Jul 30 14:01:14.161104 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:14.161016 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-cd11f9-5jg85" Jul 30 14:01:14.300135 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:14.300102 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-cd11f9-5jg85"] Jul 30 14:01:14.301804 ip-10-0-133-230 kubenswrapper[2579]: W0730 14:01:14.301782 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7e0ede9_f7fb_4a1a_811b_04b254b15202.slice/crio-7f3bee633dc2bc8f72b375bf77a38fabe6b13212e1e02c073411b26cb2fb36a7 WatchSource:0}: Error finding container 7f3bee633dc2bc8f72b375bf77a38fabe6b13212e1e02c073411b26cb2fb36a7: Status 404 returned error can't find the container with id 7f3bee633dc2bc8f72b375bf77a38fabe6b13212e1e02c073411b26cb2fb36a7 Jul 30 14:01:15.293384 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:15.293352 2579 generic.go:356] "Generic (PLEG): container finished" podID="b7e0ede9-f7fb-4a1a-811b-04b254b15202" containerID="ab36924f4f33c5d5d6e738f483bd0c698aab1845f3dda75c354cfcd299774c28" exitCode=0 Jul 30 14:01:15.293721 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:15.293450 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-cd11f9-5jg85" event={"ID":"b7e0ede9-f7fb-4a1a-811b-04b254b15202","Type":"ContainerDied","Data":"ab36924f4f33c5d5d6e738f483bd0c698aab1845f3dda75c354cfcd299774c28"} Jul 30 14:01:15.293721 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:15.293502 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-cd11f9-5jg85" event={"ID":"b7e0ede9-f7fb-4a1a-811b-04b254b15202","Type":"ContainerStarted","Data":"7f3bee633dc2bc8f72b375bf77a38fabe6b13212e1e02c073411b26cb2fb36a7"} Jul 30 14:01:15.531706 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:15.531643 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp" Jul 30 14:01:15.710525 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:15.710486 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wsn74\" (UniqueName: \"kubernetes.io/projected/20d96226-f6a9-4306-9bf2-381e06074ca1-kube-api-access-wsn74\") pod \"20d96226-f6a9-4306-9bf2-381e06074ca1\" (UID: \"20d96226-f6a9-4306-9bf2-381e06074ca1\") " Jul 30 14:01:15.710525 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:15.710527 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20d96226-f6a9-4306-9bf2-381e06074ca1-istio-envoy\") pod \"20d96226-f6a9-4306-9bf2-381e06074ca1\" (UID: \"20d96226-f6a9-4306-9bf2-381e06074ca1\") " Jul 30 14:01:15.710778 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:15.710575 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20d96226-f6a9-4306-9bf2-381e06074ca1-workload-certs\") pod \"20d96226-f6a9-4306-9bf2-381e06074ca1\" (UID: \"20d96226-f6a9-4306-9bf2-381e06074ca1\") " Jul 30 14:01:15.710778 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:15.710609 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20d96226-f6a9-4306-9bf2-381e06074ca1-workload-socket\") pod \"20d96226-f6a9-4306-9bf2-381e06074ca1\" (UID: \"20d96226-f6a9-4306-9bf2-381e06074ca1\") " Jul 30 14:01:15.710778 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:15.710642 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20d96226-f6a9-4306-9bf2-381e06074ca1-istio-token\") pod \"20d96226-f6a9-4306-9bf2-381e06074ca1\" (UID: \"20d96226-f6a9-4306-9bf2-381e06074ca1\") " Jul 30 14:01:15.710778 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:15.710663 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20d96226-f6a9-4306-9bf2-381e06074ca1-istio-data\") pod \"20d96226-f6a9-4306-9bf2-381e06074ca1\" (UID: \"20d96226-f6a9-4306-9bf2-381e06074ca1\") " Jul 30 14:01:15.710778 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:15.710700 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20d96226-f6a9-4306-9bf2-381e06074ca1-istio-podinfo\") pod \"20d96226-f6a9-4306-9bf2-381e06074ca1\" (UID: \"20d96226-f6a9-4306-9bf2-381e06074ca1\") " Jul 30 14:01:15.711035 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:15.710780 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20d96226-f6a9-4306-9bf2-381e06074ca1-istiod-ca-cert\") pod \"20d96226-f6a9-4306-9bf2-381e06074ca1\" (UID: \"20d96226-f6a9-4306-9bf2-381e06074ca1\") " Jul 30 14:01:15.711035 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:15.710834 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20d96226-f6a9-4306-9bf2-381e06074ca1-credential-socket\") pod \"20d96226-f6a9-4306-9bf2-381e06074ca1\" (UID: \"20d96226-f6a9-4306-9bf2-381e06074ca1\") " Jul 30 14:01:15.711035 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:15.710992 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20d96226-f6a9-4306-9bf2-381e06074ca1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "20d96226-f6a9-4306-9bf2-381e06074ca1" (UID: "20d96226-f6a9-4306-9bf2-381e06074ca1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 14:01:15.711035 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:15.711004 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20d96226-f6a9-4306-9bf2-381e06074ca1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "20d96226-f6a9-4306-9bf2-381e06074ca1" (UID: "20d96226-f6a9-4306-9bf2-381e06074ca1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 14:01:15.711271 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:15.711235 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20d96226-f6a9-4306-9bf2-381e06074ca1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "20d96226-f6a9-4306-9bf2-381e06074ca1" (UID: "20d96226-f6a9-4306-9bf2-381e06074ca1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 14:01:15.711271 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:15.711252 2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20d96226-f6a9-4306-9bf2-381e06074ca1-workload-certs\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 14:01:15.711380 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:15.711273 2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20d96226-f6a9-4306-9bf2-381e06074ca1-workload-socket\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 14:01:15.711380 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:15.711340 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20d96226-f6a9-4306-9bf2-381e06074ca1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "20d96226-f6a9-4306-9bf2-381e06074ca1" (UID: "20d96226-f6a9-4306-9bf2-381e06074ca1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 14:01:15.711628 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:15.711601 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20d96226-f6a9-4306-9bf2-381e06074ca1-istio-data" (OuterVolumeSpecName: "istio-data") pod "20d96226-f6a9-4306-9bf2-381e06074ca1" (UID: "20d96226-f6a9-4306-9bf2-381e06074ca1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 14:01:15.713119 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:15.713083 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/20d96226-f6a9-4306-9bf2-381e06074ca1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "20d96226-f6a9-4306-9bf2-381e06074ca1" (UID: "20d96226-f6a9-4306-9bf2-381e06074ca1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 30 14:01:15.713227 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:15.713085 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20d96226-f6a9-4306-9bf2-381e06074ca1-istio-token" (OuterVolumeSpecName: "istio-token") pod "20d96226-f6a9-4306-9bf2-381e06074ca1" (UID: "20d96226-f6a9-4306-9bf2-381e06074ca1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 14:01:15.713292 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:15.713234 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20d96226-f6a9-4306-9bf2-381e06074ca1-kube-api-access-wsn74" (OuterVolumeSpecName: "kube-api-access-wsn74") pod "20d96226-f6a9-4306-9bf2-381e06074ca1" (UID: "20d96226-f6a9-4306-9bf2-381e06074ca1"). InnerVolumeSpecName "kube-api-access-wsn74". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 14:01:15.713341 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:15.713279 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20d96226-f6a9-4306-9bf2-381e06074ca1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "20d96226-f6a9-4306-9bf2-381e06074ca1" (UID: "20d96226-f6a9-4306-9bf2-381e06074ca1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 14:01:15.811966 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:15.811866 2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20d96226-f6a9-4306-9bf2-381e06074ca1-istiod-ca-cert\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 14:01:15.811966 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:15.811899 2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20d96226-f6a9-4306-9bf2-381e06074ca1-credential-socket\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 14:01:15.811966 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:15.811917 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wsn74\" (UniqueName: \"kubernetes.io/projected/20d96226-f6a9-4306-9bf2-381e06074ca1-kube-api-access-wsn74\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 14:01:15.811966 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:15.811929 2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20d96226-f6a9-4306-9bf2-381e06074ca1-istio-envoy\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 14:01:15.811966 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:15.811941 2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20d96226-f6a9-4306-9bf2-381e06074ca1-istio-token\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 14:01:15.811966 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:15.811952 2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20d96226-f6a9-4306-9bf2-381e06074ca1-istio-data\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 14:01:15.811966 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:15.811963 2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20d96226-f6a9-4306-9bf2-381e06074ca1-istio-podinfo\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 14:01:16.301277 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:16.301239 2579 generic.go:356] "Generic (PLEG): container finished" podID="20d96226-f6a9-4306-9bf2-381e06074ca1" containerID="7625852e5363477bd64a1a2774a7ec00b893619b629dc76498aef6b4f06b15e8" exitCode=0 Jul 30 14:01:16.301748 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:16.301288 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp" Jul 30 14:01:16.301748 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:16.301324 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp" event={"ID":"20d96226-f6a9-4306-9bf2-381e06074ca1","Type":"ContainerDied","Data":"7625852e5363477bd64a1a2774a7ec00b893619b629dc76498aef6b4f06b15e8"} Jul 30 14:01:16.301748 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:16.301378 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp" event={"ID":"20d96226-f6a9-4306-9bf2-381e06074ca1","Type":"ContainerDied","Data":"c34fef5aa75e8a6e6bbcaf9bbc5b3f5a261c6a868e83ecb4e8bc786e7a5df795"} Jul 30 14:01:16.301748 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:16.301402 2579 scope.go:117] "RemoveContainer" containerID="7625852e5363477bd64a1a2774a7ec00b893619b629dc76498aef6b4f06b15e8" Jul 30 14:01:16.313536 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:16.313521 2579 scope.go:117] "RemoveContainer" containerID="9c4fd819736954cd175f2f70ab6a1ed2d6f413e9635a37794d33374e7b86e765" Jul 30 14:01:16.323712 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:16.323694 2579 scope.go:117] "RemoveContainer" containerID="7625852e5363477bd64a1a2774a7ec00b893619b629dc76498aef6b4f06b15e8" Jul 30 14:01:16.323979 ip-10-0-133-230 kubenswrapper[2579]: E0730 14:01:16.323961 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7625852e5363477bd64a1a2774a7ec00b893619b629dc76498aef6b4f06b15e8\": container with ID starting with 7625852e5363477bd64a1a2774a7ec00b893619b629dc76498aef6b4f06b15e8 not found: ID does not exist" containerID="7625852e5363477bd64a1a2774a7ec00b893619b629dc76498aef6b4f06b15e8" Jul 30 14:01:16.324163 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:16.323989 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7625852e5363477bd64a1a2774a7ec00b893619b629dc76498aef6b4f06b15e8"} err="failed to get container status \"7625852e5363477bd64a1a2774a7ec00b893619b629dc76498aef6b4f06b15e8\": rpc error: code = NotFound desc = could not find container \"7625852e5363477bd64a1a2774a7ec00b893619b629dc76498aef6b4f06b15e8\": container with ID starting with 7625852e5363477bd64a1a2774a7ec00b893619b629dc76498aef6b4f06b15e8 not found: ID does not exist" Jul 30 14:01:16.324163 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:16.324006 2579 scope.go:117] "RemoveContainer" containerID="9c4fd819736954cd175f2f70ab6a1ed2d6f413e9635a37794d33374e7b86e765" Jul 30 14:01:16.324268 ip-10-0-133-230 kubenswrapper[2579]: E0730 14:01:16.324251 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c4fd819736954cd175f2f70ab6a1ed2d6f413e9635a37794d33374e7b86e765\": container with ID starting with 9c4fd819736954cd175f2f70ab6a1ed2d6f413e9635a37794d33374e7b86e765 not found: ID does not exist" containerID="9c4fd819736954cd175f2f70ab6a1ed2d6f413e9635a37794d33374e7b86e765" Jul 30 14:01:16.324307 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:16.324270 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c4fd819736954cd175f2f70ab6a1ed2d6f413e9635a37794d33374e7b86e765"} err="failed to get container status \"9c4fd819736954cd175f2f70ab6a1ed2d6f413e9635a37794d33374e7b86e765\": rpc error: code = NotFound desc = could not find container \"9c4fd819736954cd175f2f70ab6a1ed2d6f413e9635a37794d33374e7b86e765\": container with ID starting with 9c4fd819736954cd175f2f70ab6a1ed2d6f413e9635a37794d33374e7b86e765 not found: ID does not exist" Jul 30 14:01:16.333112 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:16.333086 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp"] Jul 30 14:01:16.337331 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:16.337308 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-0e458a-openshift-default-6869f5ffc8-cn5fp"] Jul 30 14:01:16.444580 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:16.444550 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-cd11f9-5jg85" Jul 30 14:01:16.619208 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:16.619121 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7e0ede9-f7fb-4a1a-811b-04b254b15202-maas-api-service-ca\") pod \"b7e0ede9-f7fb-4a1a-811b-04b254b15202\" (UID: \"b7e0ede9-f7fb-4a1a-811b-04b254b15202\") " Jul 30 14:01:16.619504 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:16.619479 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7e0ede9-f7fb-4a1a-811b-04b254b15202-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b7e0ede9-f7fb-4a1a-811b-04b254b15202" (UID: "b7e0ede9-f7fb-4a1a-811b-04b254b15202"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 14:01:16.708050 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:16.708012 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20d96226-f6a9-4306-9bf2-381e06074ca1" path="/var/lib/kubelet/pods/20d96226-f6a9-4306-9bf2-381e06074ca1/volumes" Jul 30 14:01:16.720654 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:16.720610 2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7e0ede9-f7fb-4a1a-811b-04b254b15202-maas-api-service-ca\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 14:01:17.310119 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:17.310090 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-cd11f9-5jg85" Jul 30 14:01:17.310563 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:17.310120 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-cd11f9-5jg85" event={"ID":"b7e0ede9-f7fb-4a1a-811b-04b254b15202","Type":"ContainerDied","Data":"7f3bee633dc2bc8f72b375bf77a38fabe6b13212e1e02c073411b26cb2fb36a7"} Jul 30 14:01:17.310563 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:17.310162 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7f3bee633dc2bc8f72b375bf77a38fabe6b13212e1e02c073411b26cb2fb36a7" Jul 30 14:01:25.367270 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:25.367239 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 14:01:25.374297 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:25.374269 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-cd11f9-29757000-7g26t"] Jul 30 14:01:25.376831 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:25.376811 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-cd11f9-29757000-7g26t"] Jul 30 14:01:25.437410 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:25.437373 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 14:01:25.528676 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:25.528637 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 14:01:25.599898 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:25.599864 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 14:01:25.697271 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:25.697186 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-cd11f9-5jg85"] Jul 30 14:01:25.701241 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:25.701212 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-cd11f9-5jg85"] Jul 30 14:01:26.072898 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:26.072866 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 14:01:26.707244 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:26.707211 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b32a5bee-dbd9-4948-9d53-c8a22e332f4e" path="/var/lib/kubelet/pods/b32a5bee-dbd9-4948-9d53-c8a22e332f4e/volumes" Jul 30 14:01:26.707685 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:26.707577 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7e0ede9-f7fb-4a1a-811b-04b254b15202" path="/var/lib/kubelet/pods/b7e0ede9-f7fb-4a1a-811b-04b254b15202/volumes" Jul 30 14:01:31.148673 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:01:31.148637 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 14:02:07.767686 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:07.767603 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 14:02:08.459583 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:08.459549 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 14:02:14.492152 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:14.492119 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 14:02:14.593432 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:14.593385 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 14:02:14.793795 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:14.793689 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 14:02:15.018174 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:15.018141 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 14:02:15.166527 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:15.166433 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-2a5bef-7gghg"] Jul 30 14:02:15.166823 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:15.166805 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7e0ede9-f7fb-4a1a-811b-04b254b15202" containerName="revoke-keys" Jul 30 14:02:15.166873 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:15.166825 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7e0ede9-f7fb-4a1a-811b-04b254b15202" containerName="revoke-keys" Jul 30 14:02:15.166873 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:15.166846 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20d96226-f6a9-4306-9bf2-381e06074ca1" containerName="istio-proxy" Jul 30 14:02:15.166873 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:15.166852 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="20d96226-f6a9-4306-9bf2-381e06074ca1" containerName="istio-proxy" Jul 30 14:02:15.166873 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:15.166858 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20d96226-f6a9-4306-9bf2-381e06074ca1" containerName="istio-proxy" Jul 30 14:02:15.166873 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:15.166863 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="20d96226-f6a9-4306-9bf2-381e06074ca1" containerName="istio-proxy" Jul 30 14:02:15.167029 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:15.166924 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="20d96226-f6a9-4306-9bf2-381e06074ca1" containerName="istio-proxy" Jul 30 14:02:15.167029 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:15.166934 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="20d96226-f6a9-4306-9bf2-381e06074ca1" containerName="istio-proxy" Jul 30 14:02:15.167029 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:15.166942 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7e0ede9-f7fb-4a1a-811b-04b254b15202" containerName="revoke-keys" Jul 30 14:02:15.171466 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:15.171441 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-2a5bef-7gghg" Jul 30 14:02:15.174308 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:15.174276 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 30 14:02:15.174502 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:15.174281 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wxdpz\"" Jul 30 14:02:15.179400 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:15.179367 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-2a5bef-7gghg"] Jul 30 14:02:15.287500 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:15.287460 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/092bba11-648f-4fb0-a9e4-876fc2e2bca8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-2a5bef-7gghg\" (UID: \"092bba11-648f-4fb0-a9e4-876fc2e2bca8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-2a5bef-7gghg" Jul 30 14:02:15.388837 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:15.388797 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/092bba11-648f-4fb0-a9e4-876fc2e2bca8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-2a5bef-7gghg\" (UID: \"092bba11-648f-4fb0-a9e4-876fc2e2bca8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-2a5bef-7gghg" Jul 30 14:02:15.389484 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:15.389460 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/092bba11-648f-4fb0-a9e4-876fc2e2bca8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-2a5bef-7gghg\" (UID: \"092bba11-648f-4fb0-a9e4-876fc2e2bca8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-2a5bef-7gghg" Jul 30 14:02:15.485046 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:15.484991 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-2a5bef-7gghg" Jul 30 14:02:15.633135 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:15.633110 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-2a5bef-7gghg"] Jul 30 14:02:15.635175 ip-10-0-133-230 kubenswrapper[2579]: W0730 14:02:15.635147 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod092bba11_648f_4fb0_a9e4_876fc2e2bca8.slice/crio-74e4ec91df41a790813b09e1f1087c790276fe6e3e412e722490320406acbef6 WatchSource:0}: Error finding container 74e4ec91df41a790813b09e1f1087c790276fe6e3e412e722490320406acbef6: Status 404 returned error can't find the container with id 74e4ec91df41a790813b09e1f1087c790276fe6e3e412e722490320406acbef6 Jul 30 14:02:15.645528 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:15.645497 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-2a5bef-7gghg" event={"ID":"092bba11-648f-4fb0-a9e4-876fc2e2bca8","Type":"ContainerStarted","Data":"74e4ec91df41a790813b09e1f1087c790276fe6e3e412e722490320406acbef6"} Jul 30 14:02:16.653335 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:16.653240 2579 generic.go:356] "Generic (PLEG): container finished" podID="092bba11-648f-4fb0-a9e4-876fc2e2bca8" containerID="2d059cae0a8384d9485480b904774c372ed97b55be0f7170f7a8d8e0db6d3c82" exitCode=0 Jul 30 14:02:16.653335 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:16.653309 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-2a5bef-7gghg" event={"ID":"092bba11-648f-4fb0-a9e4-876fc2e2bca8","Type":"ContainerDied","Data":"2d059cae0a8384d9485480b904774c372ed97b55be0f7170f7a8d8e0db6d3c82"} Jul 30 14:02:17.793766 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:17.793737 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-2a5bef-7gghg" Jul 30 14:02:17.913700 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:17.913594 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/092bba11-648f-4fb0-a9e4-876fc2e2bca8-maas-api-service-ca\") pod \"092bba11-648f-4fb0-a9e4-876fc2e2bca8\" (UID: \"092bba11-648f-4fb0-a9e4-876fc2e2bca8\") " Jul 30 14:02:17.914030 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:17.914001 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/092bba11-648f-4fb0-a9e4-876fc2e2bca8-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "092bba11-648f-4fb0-a9e4-876fc2e2bca8" (UID: "092bba11-648f-4fb0-a9e4-876fc2e2bca8"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 14:02:18.014440 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:18.014373 2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/092bba11-648f-4fb0-a9e4-876fc2e2bca8-maas-api-service-ca\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 14:02:18.666565 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:18.666533 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-2a5bef-7gghg" Jul 30 14:02:18.666761 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:18.666530 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-2a5bef-7gghg" event={"ID":"092bba11-648f-4fb0-a9e4-876fc2e2bca8","Type":"ContainerDied","Data":"74e4ec91df41a790813b09e1f1087c790276fe6e3e412e722490320406acbef6"} Jul 30 14:02:18.666761 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:18.666700 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="74e4ec91df41a790813b09e1f1087c790276fe6e3e412e722490320406acbef6" Jul 30 14:02:20.153657 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:20.153616 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 14:02:20.159179 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:20.159144 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-2a5bef-29757000-85ssq"] Jul 30 14:02:20.161839 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:20.161812 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-2a5bef-29757000-85ssq"] Jul 30 14:02:20.223336 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:20.223301 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 14:02:20.285437 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:20.285386 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 14:02:20.330845 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:20.330802 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-2a5bef-7gghg"] Jul 30 14:02:20.333132 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:20.333111 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-2a5bef-7gghg"] Jul 30 14:02:20.351238 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:20.351179 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 14:02:20.700866 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:20.700835 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 14:02:20.707106 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:20.707078 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="092bba11-648f-4fb0-a9e4-876fc2e2bca8" path="/var/lib/kubelet/pods/092bba11-648f-4fb0-a9e4-876fc2e2bca8/volumes" Jul 30 14:02:20.707368 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:20.707355 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e5086c5-2e38-4b90-a3bc-481944d66dbc" path="/var/lib/kubelet/pods/5e5086c5-2e38-4b90-a3bc-481944d66dbc/volumes" Jul 30 14:02:26.528471 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:26.528437 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 14:02:26.625119 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:26.625084 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 14:02:26.769686 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:26.769652 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6"] Jul 30 14:02:26.769953 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:26.769912 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6" podUID="bac0cc3e-2d4e-4101-9256-b3424398ff7d" containerName="istio-proxy" containerID="cri-o://2ef1f835a6d04c5e81f17501bac3d5fdb35b72374f41bb16ad51f998fc540658" gracePeriod=30 Jul 30 14:02:26.797240 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:26.797163 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 14:02:27.022022 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:27.021983 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 14:02:27.652586 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:27.652550 2579 patch_prober.go:28] interesting pod/e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 30 14:02:27.652985 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:27.652614 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6" podUID="bac0cc3e-2d4e-4101-9256-b3424398ff7d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 30 14:02:32.029678 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:32.029645 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6" Jul 30 14:02:32.155241 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:32.155143 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bac0cc3e-2d4e-4101-9256-b3424398ff7d-workload-certs\") pod \"bac0cc3e-2d4e-4101-9256-b3424398ff7d\" (UID: \"bac0cc3e-2d4e-4101-9256-b3424398ff7d\") " Jul 30 14:02:32.155241 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:32.155230 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bac0cc3e-2d4e-4101-9256-b3424398ff7d-istio-data\") pod \"bac0cc3e-2d4e-4101-9256-b3424398ff7d\" (UID: \"bac0cc3e-2d4e-4101-9256-b3424398ff7d\") " Jul 30 14:02:32.155519 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:32.155262 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bac0cc3e-2d4e-4101-9256-b3424398ff7d-istio-token\") pod \"bac0cc3e-2d4e-4101-9256-b3424398ff7d\" (UID: \"bac0cc3e-2d4e-4101-9256-b3424398ff7d\") " Jul 30 14:02:32.155519 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:32.155396 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bac0cc3e-2d4e-4101-9256-b3424398ff7d-workload-socket\") pod \"bac0cc3e-2d4e-4101-9256-b3424398ff7d\" (UID: \"bac0cc3e-2d4e-4101-9256-b3424398ff7d\") " Jul 30 14:02:32.155620 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:32.155518 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bac0cc3e-2d4e-4101-9256-b3424398ff7d-istio-envoy\") pod \"bac0cc3e-2d4e-4101-9256-b3424398ff7d\" (UID: \"bac0cc3e-2d4e-4101-9256-b3424398ff7d\") " Jul 30 14:02:32.155620 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:32.155523 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bac0cc3e-2d4e-4101-9256-b3424398ff7d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bac0cc3e-2d4e-4101-9256-b3424398ff7d" (UID: "bac0cc3e-2d4e-4101-9256-b3424398ff7d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 14:02:32.155620 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:32.155583 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bac0cc3e-2d4e-4101-9256-b3424398ff7d-istiod-ca-cert\") pod \"bac0cc3e-2d4e-4101-9256-b3424398ff7d\" (UID: \"bac0cc3e-2d4e-4101-9256-b3424398ff7d\") " Jul 30 14:02:32.155782 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:32.155620 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ljzrq\" (UniqueName: \"kubernetes.io/projected/bac0cc3e-2d4e-4101-9256-b3424398ff7d-kube-api-access-ljzrq\") pod \"bac0cc3e-2d4e-4101-9256-b3424398ff7d\" (UID: \"bac0cc3e-2d4e-4101-9256-b3424398ff7d\") " Jul 30 14:02:32.155782 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:32.155642 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bac0cc3e-2d4e-4101-9256-b3424398ff7d-credential-socket\") pod \"bac0cc3e-2d4e-4101-9256-b3424398ff7d\" (UID: \"bac0cc3e-2d4e-4101-9256-b3424398ff7d\") " Jul 30 14:02:32.155782 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:32.155669 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bac0cc3e-2d4e-4101-9256-b3424398ff7d-istio-podinfo\") pod \"bac0cc3e-2d4e-4101-9256-b3424398ff7d\" (UID: \"bac0cc3e-2d4e-4101-9256-b3424398ff7d\") " Jul 30 14:02:32.155782 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:32.155683 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bac0cc3e-2d4e-4101-9256-b3424398ff7d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bac0cc3e-2d4e-4101-9256-b3424398ff7d" (UID: "bac0cc3e-2d4e-4101-9256-b3424398ff7d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 14:02:32.156012 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:32.155848 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bac0cc3e-2d4e-4101-9256-b3424398ff7d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bac0cc3e-2d4e-4101-9256-b3424398ff7d" (UID: "bac0cc3e-2d4e-4101-9256-b3424398ff7d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 14:02:32.156072 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:32.156034 2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bac0cc3e-2d4e-4101-9256-b3424398ff7d-workload-socket\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 14:02:32.156072 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:32.156059 2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bac0cc3e-2d4e-4101-9256-b3424398ff7d-credential-socket\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 14:02:32.156185 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:32.156074 2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bac0cc3e-2d4e-4101-9256-b3424398ff7d-workload-certs\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 14:02:32.156185 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:32.156131 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bac0cc3e-2d4e-4101-9256-b3424398ff7d-istio-data" (OuterVolumeSpecName: "istio-data") pod "bac0cc3e-2d4e-4101-9256-b3424398ff7d" (UID: "bac0cc3e-2d4e-4101-9256-b3424398ff7d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 14:02:32.156482 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:32.156453 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bac0cc3e-2d4e-4101-9256-b3424398ff7d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bac0cc3e-2d4e-4101-9256-b3424398ff7d" (UID: "bac0cc3e-2d4e-4101-9256-b3424398ff7d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 14:02:32.157785 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:32.157754 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bac0cc3e-2d4e-4101-9256-b3424398ff7d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bac0cc3e-2d4e-4101-9256-b3424398ff7d" (UID: "bac0cc3e-2d4e-4101-9256-b3424398ff7d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 14:02:32.157884 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:32.157842 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bac0cc3e-2d4e-4101-9256-b3424398ff7d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bac0cc3e-2d4e-4101-9256-b3424398ff7d" (UID: "bac0cc3e-2d4e-4101-9256-b3424398ff7d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 30 14:02:32.157884 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:32.157872 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bac0cc3e-2d4e-4101-9256-b3424398ff7d-istio-token" (OuterVolumeSpecName: "istio-token") pod "bac0cc3e-2d4e-4101-9256-b3424398ff7d" (UID: "bac0cc3e-2d4e-4101-9256-b3424398ff7d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 14:02:32.158041 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:32.158017 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bac0cc3e-2d4e-4101-9256-b3424398ff7d-kube-api-access-ljzrq" (OuterVolumeSpecName: "kube-api-access-ljzrq") pod "bac0cc3e-2d4e-4101-9256-b3424398ff7d" (UID: "bac0cc3e-2d4e-4101-9256-b3424398ff7d"). InnerVolumeSpecName "kube-api-access-ljzrq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 14:02:32.257013 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:32.256969 2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bac0cc3e-2d4e-4101-9256-b3424398ff7d-istio-data\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 14:02:32.257013 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:32.257006 2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bac0cc3e-2d4e-4101-9256-b3424398ff7d-istio-token\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 14:02:32.257013 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:32.257017 2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bac0cc3e-2d4e-4101-9256-b3424398ff7d-istio-envoy\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 14:02:32.257270 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:32.257028 2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bac0cc3e-2d4e-4101-9256-b3424398ff7d-istiod-ca-cert\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 14:02:32.257270 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:32.257041 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ljzrq\" (UniqueName: \"kubernetes.io/projected/bac0cc3e-2d4e-4101-9256-b3424398ff7d-kube-api-access-ljzrq\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 14:02:32.257270 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:32.257054 2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bac0cc3e-2d4e-4101-9256-b3424398ff7d-istio-podinfo\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 14:02:32.746054 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:32.746019 2579 generic.go:356] "Generic (PLEG): container finished" podID="bac0cc3e-2d4e-4101-9256-b3424398ff7d" containerID="2ef1f835a6d04c5e81f17501bac3d5fdb35b72374f41bb16ad51f998fc540658" exitCode=0 Jul 30 14:02:32.746278 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:32.746079 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6" event={"ID":"bac0cc3e-2d4e-4101-9256-b3424398ff7d","Type":"ContainerDied","Data":"2ef1f835a6d04c5e81f17501bac3d5fdb35b72374f41bb16ad51f998fc540658"} Jul 30 14:02:32.746278 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:32.746085 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6" Jul 30 14:02:32.746278 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:32.746125 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6" event={"ID":"bac0cc3e-2d4e-4101-9256-b3424398ff7d","Type":"ContainerDied","Data":"bfcfdcc81af5a462294a1f54d5b6fb12b9742e2564c68c7594d8f80e54a95045"} Jul 30 14:02:32.746278 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:32.746149 2579 scope.go:117] "RemoveContainer" containerID="2ef1f835a6d04c5e81f17501bac3d5fdb35b72374f41bb16ad51f998fc540658" Jul 30 14:02:32.756051 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:32.756030 2579 scope.go:117] "RemoveContainer" containerID="4eb4236c75c83bc139d9b3c87e135db17f0123abcbfd03061832a4371acb4b2b" Jul 30 14:02:32.765236 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:32.765205 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6"] Jul 30 14:02:32.766038 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:32.766017 2579 scope.go:117] "RemoveContainer" containerID="2ef1f835a6d04c5e81f17501bac3d5fdb35b72374f41bb16ad51f998fc540658" Jul 30 14:02:32.766344 ip-10-0-133-230 kubenswrapper[2579]: E0730 14:02:32.766325 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ef1f835a6d04c5e81f17501bac3d5fdb35b72374f41bb16ad51f998fc540658\": container with ID starting with 2ef1f835a6d04c5e81f17501bac3d5fdb35b72374f41bb16ad51f998fc540658 not found: ID does not exist" containerID="2ef1f835a6d04c5e81f17501bac3d5fdb35b72374f41bb16ad51f998fc540658" Jul 30 14:02:32.766426 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:32.766351 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ef1f835a6d04c5e81f17501bac3d5fdb35b72374f41bb16ad51f998fc540658"} err="failed to get container status \"2ef1f835a6d04c5e81f17501bac3d5fdb35b72374f41bb16ad51f998fc540658\": rpc error: code = NotFound desc = could not find container \"2ef1f835a6d04c5e81f17501bac3d5fdb35b72374f41bb16ad51f998fc540658\": container with ID starting with 2ef1f835a6d04c5e81f17501bac3d5fdb35b72374f41bb16ad51f998fc540658 not found: ID does not exist" Jul 30 14:02:32.766426 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:32.766370 2579 scope.go:117] "RemoveContainer" containerID="4eb4236c75c83bc139d9b3c87e135db17f0123abcbfd03061832a4371acb4b2b" Jul 30 14:02:32.766678 ip-10-0-133-230 kubenswrapper[2579]: E0730 14:02:32.766656 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4eb4236c75c83bc139d9b3c87e135db17f0123abcbfd03061832a4371acb4b2b\": container with ID starting with 4eb4236c75c83bc139d9b3c87e135db17f0123abcbfd03061832a4371acb4b2b not found: ID does not exist" containerID="4eb4236c75c83bc139d9b3c87e135db17f0123abcbfd03061832a4371acb4b2b" Jul 30 14:02:32.766749 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:32.766682 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4eb4236c75c83bc139d9b3c87e135db17f0123abcbfd03061832a4371acb4b2b"} err="failed to get container status \"4eb4236c75c83bc139d9b3c87e135db17f0123abcbfd03061832a4371acb4b2b\": rpc error: code = NotFound desc = could not find container \"4eb4236c75c83bc139d9b3c87e135db17f0123abcbfd03061832a4371acb4b2b\": container with ID starting with 4eb4236c75c83bc139d9b3c87e135db17f0123abcbfd03061832a4371acb4b2b not found: ID does not exist" Jul 30 14:02:32.771484 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:32.771456 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-2a5bef-openshift-default-78f5f7c76b-jc5x6"] Jul 30 14:02:33.451150 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:33.451120 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 14:02:33.452379 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:33.452348 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f4dc0a-29757000-r6bp4"] Jul 30 14:02:33.454773 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:33.454747 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f4dc0a-29757000-r6bp4"] Jul 30 14:02:33.530209 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:33.530181 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 14:02:33.602050 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:33.602019 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 14:02:33.684059 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:33.684027 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 14:02:34.064909 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:34.064878 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 14:02:34.708185 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:34.708147 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="581232ff-aec1-44c6-ab65-29597000a70e" path="/var/lib/kubelet/pods/581232ff-aec1-44c6-ab65-29597000a70e/volumes" Jul 30 14:02:34.708592 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:34.708571 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bac0cc3e-2d4e-4101-9256-b3424398ff7d" path="/var/lib/kubelet/pods/bac0cc3e-2d4e-4101-9256-b3424398ff7d/volumes" Jul 30 14:02:39.902316 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:39.902285 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 14:02:39.971628 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:39.971588 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 14:02:40.176624 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:40.176523 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 14:02:40.524026 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:40.523994 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e945a1-gvnqt"] Jul 30 14:02:40.524477 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:40.524459 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bac0cc3e-2d4e-4101-9256-b3424398ff7d" containerName="istio-proxy" Jul 30 14:02:40.524583 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:40.524479 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="bac0cc3e-2d4e-4101-9256-b3424398ff7d" containerName="istio-proxy" Jul 30 14:02:40.524583 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:40.524508 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="092bba11-648f-4fb0-a9e4-876fc2e2bca8" containerName="revoke-keys" Jul 30 14:02:40.524583 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:40.524517 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="092bba11-648f-4fb0-a9e4-876fc2e2bca8" containerName="revoke-keys" Jul 30 14:02:40.524742 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:40.524628 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="092bba11-648f-4fb0-a9e4-876fc2e2bca8" containerName="revoke-keys" Jul 30 14:02:40.524742 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:40.524642 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="bac0cc3e-2d4e-4101-9256-b3424398ff7d" containerName="istio-proxy" Jul 30 14:02:40.529398 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:40.529375 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e945a1-gvnqt" Jul 30 14:02:40.532200 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:40.532173 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wxdpz\"" Jul 30 14:02:40.532967 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:40.532942 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 30 14:02:40.535253 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:40.535231 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e945a1-gvnqt"] Jul 30 14:02:40.629582 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:40.629535 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ea62797-6c9f-4d14-be1f-2da8f0d92546-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-e945a1-gvnqt\" (UID: \"4ea62797-6c9f-4d14-be1f-2da8f0d92546\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e945a1-gvnqt" Jul 30 14:02:40.730142 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:40.730108 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ea62797-6c9f-4d14-be1f-2da8f0d92546-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-e945a1-gvnqt\" (UID: \"4ea62797-6c9f-4d14-be1f-2da8f0d92546\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e945a1-gvnqt" Jul 30 14:02:40.730750 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:40.730730 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ea62797-6c9f-4d14-be1f-2da8f0d92546-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-e945a1-gvnqt\" (UID: \"4ea62797-6c9f-4d14-be1f-2da8f0d92546\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e945a1-gvnqt" Jul 30 14:02:40.754731 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:40.754695 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 14:02:40.842788 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:40.842697 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e945a1-gvnqt" Jul 30 14:02:40.981576 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:40.981544 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e945a1-gvnqt"] Jul 30 14:02:40.983086 ip-10-0-133-230 kubenswrapper[2579]: W0730 14:02:40.983057 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ea62797_6c9f_4d14_be1f_2da8f0d92546.slice/crio-2ce41043e00e046e1c6bebc84c072a0683eaa78889cdb60bf367ee18495dac5b WatchSource:0}: Error finding container 2ce41043e00e046e1c6bebc84c072a0683eaa78889cdb60bf367ee18495dac5b: Status 404 returned error can't find the container with id 2ce41043e00e046e1c6bebc84c072a0683eaa78889cdb60bf367ee18495dac5b Jul 30 14:02:41.799622 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:41.799582 2579 generic.go:356] "Generic (PLEG): container finished" podID="4ea62797-6c9f-4d14-be1f-2da8f0d92546" containerID="489350ec942422d3673d8d7f27e2ecc9cdee3eb52464a7bb6faffab31ea7568a" exitCode=0 Jul 30 14:02:41.799812 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:41.799671 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e945a1-gvnqt" event={"ID":"4ea62797-6c9f-4d14-be1f-2da8f0d92546","Type":"ContainerDied","Data":"489350ec942422d3673d8d7f27e2ecc9cdee3eb52464a7bb6faffab31ea7568a"} Jul 30 14:02:41.799812 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:41.799747 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e945a1-gvnqt" event={"ID":"4ea62797-6c9f-4d14-be1f-2da8f0d92546","Type":"ContainerStarted","Data":"2ce41043e00e046e1c6bebc84c072a0683eaa78889cdb60bf367ee18495dac5b"} Jul 30 14:02:42.944399 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:42.944370 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e945a1-gvnqt" Jul 30 14:02:43.053019 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:43.052987 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ea62797-6c9f-4d14-be1f-2da8f0d92546-maas-api-service-ca\") pod \"4ea62797-6c9f-4d14-be1f-2da8f0d92546\" (UID: \"4ea62797-6c9f-4d14-be1f-2da8f0d92546\") " Jul 30 14:02:43.053388 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:43.053363 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ea62797-6c9f-4d14-be1f-2da8f0d92546-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4ea62797-6c9f-4d14-be1f-2da8f0d92546" (UID: "4ea62797-6c9f-4d14-be1f-2da8f0d92546"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 14:02:43.153850 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:43.153762 2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ea62797-6c9f-4d14-be1f-2da8f0d92546-maas-api-service-ca\") on node \"ip-10-0-133-230.ec2.internal\" DevicePath \"\"" Jul 30 14:02:43.812597 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:43.812566 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e945a1-gvnqt" Jul 30 14:02:43.812777 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:43.812570 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e945a1-gvnqt" event={"ID":"4ea62797-6c9f-4d14-be1f-2da8f0d92546","Type":"ContainerDied","Data":"2ce41043e00e046e1c6bebc84c072a0683eaa78889cdb60bf367ee18495dac5b"} Jul 30 14:02:43.812777 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:43.812687 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2ce41043e00e046e1c6bebc84c072a0683eaa78889cdb60bf367ee18495dac5b" Jul 30 14:02:50.944083 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:50.944035 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e945a1-29757000-zk9j7"] Jul 30 14:02:50.946957 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:50.946932 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e945a1-29757000-zk9j7"] Jul 30 14:02:50.949713 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:50.949684 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 14:02:51.034213 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:51.034173 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 14:02:51.150848 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:51.150740 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 14:02:51.152490 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:51.152460 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e945a1-gvnqt"] Jul 30 14:02:51.156120 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:51.156092 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e945a1-gvnqt"] Jul 30 14:02:51.547305 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:51.547251 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 14:02:52.707649 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:52.707617 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ea62797-6c9f-4d14-be1f-2da8f0d92546" path="/var/lib/kubelet/pods/4ea62797-6c9f-4d14-be1f-2da8f0d92546/volumes" Jul 30 14:02:52.708038 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:52.707938 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3a0e66e-2e01-4f68-952a-47df7db5c9da" path="/var/lib/kubelet/pods/f3a0e66e-2e01-4f68-952a-47df7db5c9da/volumes" Jul 30 14:02:57.590621 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:57.590584 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 14:02:57.691536 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:57.691505 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 14:02:57.887220 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:57.887129 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 14:02:58.099685 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:58.099647 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 14:02:58.271092 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:02:58.271024 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 14:03:06.028539 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:06.028505 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6bd55cb6f4-xcfbz_e7988f8a-ec3f-41fa-a517-9ca561628770/copy-manifests/0.log" Jul 30 14:03:06.035499 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:06.035472 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6bd55cb6f4-xcfbz_e7988f8a-ec3f-41fa-a517-9ca561628770/manager/0.log" Jul 30 14:03:06.908955 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:06.908925 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29757000-hxs2j_717946ba-a60a-415f-af82-076da28b27c0/cleanup/0.log" Jul 30 14:03:07.904826 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:07.904794 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599l7j4_919dcf41-659d-4a1a-bd60-02bacc954f13/util/0.log" Jul 30 14:03:07.911843 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:07.911814 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599l7j4_919dcf41-659d-4a1a-bd60-02bacc954f13/pull/0.log" Jul 30 14:03:07.918294 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:07.918273 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599l7j4_919dcf41-659d-4a1a-bd60-02bacc954f13/extract/0.log" Jul 30 14:03:08.046044 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:08.046007 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2h7r_c46530cc-1c2f-47f1-9889-abbd30f314f8/util/0.log" Jul 30 14:03:08.054397 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:08.054372 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2h7r_c46530cc-1c2f-47f1-9889-abbd30f314f8/pull/0.log" Jul 30 14:03:08.061281 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:08.061261 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2h7r_c46530cc-1c2f-47f1-9889-abbd30f314f8/extract/0.log" Jul 30 14:03:08.195722 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:08.195640 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g956q_469070c9-6c31-445c-8795-55e304582f6e/pull/0.log" Jul 30 14:03:08.202596 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:08.202572 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g956q_469070c9-6c31-445c-8795-55e304582f6e/extract/0.log" Jul 30 14:03:08.209090 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:08.209066 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g956q_469070c9-6c31-445c-8795-55e304582f6e/util/0.log" Jul 30 14:03:08.335498 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:08.335462 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kkgzg_9f64c58c-5a9c-446d-8e97-0893e17b4961/extract/0.log" Jul 30 14:03:08.342036 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:08.342019 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kkgzg_9f64c58c-5a9c-446d-8e97-0893e17b4961/util/0.log" Jul 30 14:03:08.348530 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:08.348508 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kkgzg_9f64c58c-5a9c-446d-8e97-0893e17b4961/pull/0.log" Jul 30 14:03:09.720646 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:09.720615 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-cch52_ed205912-55a1-484b-bf85-f76d5ceadfc7/istio-proxy/0.log" Jul 30 14:03:09.850350 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:09.850319 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-xz75p_86ada943-10c1-4872-85f2-1295a2e95aeb/discovery/0.log" Jul 30 14:03:10.229224 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:10.229189 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-jnmtt_900cf9c9-d235-48e9-b7e4-fc46e8e0b742/istio-proxy/1.log" Jul 30 14:03:10.640668 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:10.640588 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-57f58cdc8c-xn7bm_5703055a-5a1f-4546-bb90-1ca9d22e0933/router/0.log" Jul 30 14:03:11.136653 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:11.136623 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-zmj6m_b59a8d42-7a93-4879-8c6d-7db76d48e92d/main/0.log" Jul 30 14:03:11.378425 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:11.378387 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvkqpn_94a17c8b-a4ef-4aec-938d-764c45085cd8/main/0.log" Jul 30 14:03:11.507599 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:11.507572 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-2wkfv_efcc897e-13fd-4d1b-b144-9de37adeeecb/main/0.log" Jul 30 14:03:17.829237 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:17.829199 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 14:03:17.946055 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:17.946013 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" limit=1024 Jul 30 14:03:21.146634 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:21.146603 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-xzq9h_e4027c79-c8b8-4800-9db1-843170f52290/global-pull-secret-syncer/0.log" Jul 30 14:03:21.199657 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:21.199627 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-cbrzj_c1cb0fbf-c955-4c33-95fa-a70c1110aa3b/konnectivity-agent/0.log" Jul 30 14:03:21.312852 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:21.312815 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-230.ec2.internal_b39ac35dac0bf47dea91e3680de30c40/haproxy/0.log" Jul 30 14:03:26.223373 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:26.223340 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599l7j4_919dcf41-659d-4a1a-bd60-02bacc954f13/extract/0.log" Jul 30 14:03:26.247751 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:26.247725 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599l7j4_919dcf41-659d-4a1a-bd60-02bacc954f13/util/0.log" Jul 30 14:03:26.269223 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:26.269198 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599l7j4_919dcf41-659d-4a1a-bd60-02bacc954f13/pull/0.log" Jul 30 14:03:26.301472 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:26.301447 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2h7r_c46530cc-1c2f-47f1-9889-abbd30f314f8/extract/0.log" Jul 30 14:03:26.321829 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:26.321805 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2h7r_c46530cc-1c2f-47f1-9889-abbd30f314f8/util/0.log" Jul 30 14:03:26.349574 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:26.349554 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x2h7r_c46530cc-1c2f-47f1-9889-abbd30f314f8/pull/0.log" Jul 30 14:03:26.383113 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:26.383083 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g956q_469070c9-6c31-445c-8795-55e304582f6e/extract/0.log" Jul 30 14:03:26.404268 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:26.404240 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g956q_469070c9-6c31-445c-8795-55e304582f6e/util/0.log" Jul 30 14:03:26.424758 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:26.424731 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g956q_469070c9-6c31-445c-8795-55e304582f6e/pull/0.log" Jul 30 14:03:26.451281 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:26.451256 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kkgzg_9f64c58c-5a9c-446d-8e97-0893e17b4961/extract/0.log" Jul 30 14:03:26.470392 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:26.470371 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kkgzg_9f64c58c-5a9c-446d-8e97-0893e17b4961/util/0.log" Jul 30 14:03:26.490567 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:26.490496 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kkgzg_9f64c58c-5a9c-446d-8e97-0893e17b4961/pull/0.log" Jul 30 14:03:29.271761 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:29.271668 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_728412e0-8766-485c-82d1-221562611c23/alertmanager/0.log" Jul 30 14:03:29.290343 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:29.290315 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_728412e0-8766-485c-82d1-221562611c23/config-reloader/0.log" Jul 30 14:03:29.308900 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:29.308874 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_728412e0-8766-485c-82d1-221562611c23/kube-rbac-proxy-web/0.log" Jul 30 14:03:29.330851 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:29.330811 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_728412e0-8766-485c-82d1-221562611c23/kube-rbac-proxy/0.log" Jul 30 14:03:29.350616 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:29.350576 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_728412e0-8766-485c-82d1-221562611c23/kube-rbac-proxy-metric/0.log" Jul 30 14:03:29.369008 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:29.368982 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_728412e0-8766-485c-82d1-221562611c23/prom-label-proxy/0.log" Jul 30 14:03:29.416913 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:29.416871 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_728412e0-8766-485c-82d1-221562611c23/init-config-reloader/0.log" Jul 30 14:03:29.489270 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:29.489242 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-m9c2p_48618460-2f56-435e-8881-8ef2f4953a3c/kube-state-metrics/0.log" Jul 30 14:03:29.506333 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:29.506308 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-m9c2p_48618460-2f56-435e-8881-8ef2f4953a3c/kube-rbac-proxy-main/0.log" Jul 30 14:03:29.533386 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:29.533312 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-m9c2p_48618460-2f56-435e-8881-8ef2f4953a3c/kube-rbac-proxy-self/0.log" Jul 30 14:03:29.742609 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:29.742580 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wdgs6_3ca431c8-386a-471a-9828-26f8c576d1b8/node-exporter/0.log" Jul 30 14:03:29.761328 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:29.761303 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wdgs6_3ca431c8-386a-471a-9828-26f8c576d1b8/kube-rbac-proxy/0.log" Jul 30 14:03:29.779910 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:29.779887 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wdgs6_3ca431c8-386a-471a-9828-26f8c576d1b8/init-textfile/0.log" Jul 30 14:03:30.027965 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:30.027934 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-vn5xr_6011c549-7f3f-4bde-a2f3-f430490ef0d0/prometheus-operator/0.log" Jul 30 14:03:30.045233 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:30.045209 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-vn5xr_6011c549-7f3f-4bde-a2f3-f430490ef0d0/kube-rbac-proxy/0.log" Jul 30 14:03:30.066767 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:30.066740 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-b9vtd_96d40ad6-d152-445b-bdb8-c78cfca04145/prometheus-operator-admission-webhook/0.log" Jul 30 14:03:30.108126 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:30.108093 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-59f64b9746-b45g5_ad964398-924e-4920-b1b2-d1020880cc2e/telemeter-client/0.log" Jul 30 14:03:30.128923 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:30.128894 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-59f64b9746-b45g5_ad964398-924e-4920-b1b2-d1020880cc2e/reload/0.log" Jul 30 14:03:30.147804 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:30.147779 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-59f64b9746-b45g5_ad964398-924e-4920-b1b2-d1020880cc2e/kube-rbac-proxy/0.log" Jul 30 14:03:31.077153 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:31.077125 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-nd8l9/perf-node-gather-daemonset-m7smw"] Jul 30 14:03:31.077580 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:31.077514 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ea62797-6c9f-4d14-be1f-2da8f0d92546" containerName="revoke-keys" Jul 30 14:03:31.077580 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:31.077531 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ea62797-6c9f-4d14-be1f-2da8f0d92546" containerName="revoke-keys" Jul 30 14:03:31.077580 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:31.077545 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bac0cc3e-2d4e-4101-9256-b3424398ff7d" containerName="istio-proxy" Jul 30 14:03:31.077580 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:31.077554 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="bac0cc3e-2d4e-4101-9256-b3424398ff7d" containerName="istio-proxy" Jul 30 14:03:31.077816 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:31.077670 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ea62797-6c9f-4d14-be1f-2da8f0d92546" containerName="revoke-keys" Jul 30 14:03:31.077816 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:31.077684 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="bac0cc3e-2d4e-4101-9256-b3424398ff7d" containerName="istio-proxy" Jul 30 14:03:31.080839 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:31.080821 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nd8l9/perf-node-gather-daemonset-m7smw" Jul 30 14:03:31.083352 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:31.083328 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nd8l9\"/\"kube-root-ca.crt\"" Jul 30 14:03:31.083497 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:31.083399 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nd8l9\"/\"openshift-service-ca.crt\"" Jul 30 14:03:31.083729 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:31.083713 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-nd8l9\"/\"default-dockercfg-fnqxp\"" Jul 30 14:03:31.096199 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:31.096170 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nd8l9/perf-node-gather-daemonset-m7smw"] Jul 30 14:03:31.115810 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:31.115775 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9dd4614c-87ea-4fe9-add2-8bc6e7470c6c-podres\") pod \"perf-node-gather-daemonset-m7smw\" (UID: \"9dd4614c-87ea-4fe9-add2-8bc6e7470c6c\") " pod="openshift-must-gather-nd8l9/perf-node-gather-daemonset-m7smw" Jul 30 14:03:31.115810 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:31.115809 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9dd4614c-87ea-4fe9-add2-8bc6e7470c6c-lib-modules\") pod \"perf-node-gather-daemonset-m7smw\" (UID: \"9dd4614c-87ea-4fe9-add2-8bc6e7470c6c\") " pod="openshift-must-gather-nd8l9/perf-node-gather-daemonset-m7smw" Jul 30 14:03:31.116010 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:31.115899 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9dd4614c-87ea-4fe9-add2-8bc6e7470c6c-proc\") pod \"perf-node-gather-daemonset-m7smw\" (UID: \"9dd4614c-87ea-4fe9-add2-8bc6e7470c6c\") " pod="openshift-must-gather-nd8l9/perf-node-gather-daemonset-m7smw" Jul 30 14:03:31.116010 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:31.115976 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9dd4614c-87ea-4fe9-add2-8bc6e7470c6c-sys\") pod \"perf-node-gather-daemonset-m7smw\" (UID: \"9dd4614c-87ea-4fe9-add2-8bc6e7470c6c\") " pod="openshift-must-gather-nd8l9/perf-node-gather-daemonset-m7smw" Jul 30 14:03:31.116091 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:31.116016 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92wdg\" (UniqueName: \"kubernetes.io/projected/9dd4614c-87ea-4fe9-add2-8bc6e7470c6c-kube-api-access-92wdg\") pod \"perf-node-gather-daemonset-m7smw\" (UID: \"9dd4614c-87ea-4fe9-add2-8bc6e7470c6c\") " pod="openshift-must-gather-nd8l9/perf-node-gather-daemonset-m7smw" Jul 30 14:03:31.217580 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:31.217531 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9dd4614c-87ea-4fe9-add2-8bc6e7470c6c-sys\") pod \"perf-node-gather-daemonset-m7smw\" (UID: \"9dd4614c-87ea-4fe9-add2-8bc6e7470c6c\") " pod="openshift-must-gather-nd8l9/perf-node-gather-daemonset-m7smw" Jul 30 14:03:31.217789 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:31.217606 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92wdg\" (UniqueName: \"kubernetes.io/projected/9dd4614c-87ea-4fe9-add2-8bc6e7470c6c-kube-api-access-92wdg\") pod \"perf-node-gather-daemonset-m7smw\" (UID: \"9dd4614c-87ea-4fe9-add2-8bc6e7470c6c\") " pod="openshift-must-gather-nd8l9/perf-node-gather-daemonset-m7smw" Jul 30 14:03:31.217789 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:31.217656 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9dd4614c-87ea-4fe9-add2-8bc6e7470c6c-podres\") pod \"perf-node-gather-daemonset-m7smw\" (UID: \"9dd4614c-87ea-4fe9-add2-8bc6e7470c6c\") " pod="openshift-must-gather-nd8l9/perf-node-gather-daemonset-m7smw" Jul 30 14:03:31.217789 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:31.217668 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9dd4614c-87ea-4fe9-add2-8bc6e7470c6c-sys\") pod \"perf-node-gather-daemonset-m7smw\" (UID: \"9dd4614c-87ea-4fe9-add2-8bc6e7470c6c\") " pod="openshift-must-gather-nd8l9/perf-node-gather-daemonset-m7smw" Jul 30 14:03:31.217789 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:31.217678 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9dd4614c-87ea-4fe9-add2-8bc6e7470c6c-lib-modules\") pod \"perf-node-gather-daemonset-m7smw\" (UID: \"9dd4614c-87ea-4fe9-add2-8bc6e7470c6c\") " pod="openshift-must-gather-nd8l9/perf-node-gather-daemonset-m7smw" Jul 30 14:03:31.217957 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:31.217793 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9dd4614c-87ea-4fe9-add2-8bc6e7470c6c-proc\") pod \"perf-node-gather-daemonset-m7smw\" (UID: \"9dd4614c-87ea-4fe9-add2-8bc6e7470c6c\") " pod="openshift-must-gather-nd8l9/perf-node-gather-daemonset-m7smw" Jul 30 14:03:31.217957 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:31.217796 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9dd4614c-87ea-4fe9-add2-8bc6e7470c6c-podres\") pod \"perf-node-gather-daemonset-m7smw\" (UID: \"9dd4614c-87ea-4fe9-add2-8bc6e7470c6c\") " pod="openshift-must-gather-nd8l9/perf-node-gather-daemonset-m7smw" Jul 30 14:03:31.217957 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:31.217849 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9dd4614c-87ea-4fe9-add2-8bc6e7470c6c-proc\") pod \"perf-node-gather-daemonset-m7smw\" (UID: \"9dd4614c-87ea-4fe9-add2-8bc6e7470c6c\") " pod="openshift-must-gather-nd8l9/perf-node-gather-daemonset-m7smw" Jul 30 14:03:31.217957 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:31.217803 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9dd4614c-87ea-4fe9-add2-8bc6e7470c6c-lib-modules\") pod \"perf-node-gather-daemonset-m7smw\" (UID: \"9dd4614c-87ea-4fe9-add2-8bc6e7470c6c\") " pod="openshift-must-gather-nd8l9/perf-node-gather-daemonset-m7smw" Jul 30 14:03:31.225952 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:31.225929 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92wdg\" (UniqueName: \"kubernetes.io/projected/9dd4614c-87ea-4fe9-add2-8bc6e7470c6c-kube-api-access-92wdg\") pod \"perf-node-gather-daemonset-m7smw\" (UID: \"9dd4614c-87ea-4fe9-add2-8bc6e7470c6c\") " pod="openshift-must-gather-nd8l9/perf-node-gather-daemonset-m7smw" Jul 30 14:03:31.355221 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:31.355138 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-cc2dk_5c9ec6ef-6498-4094-8613-fb3a59fa4e24/networking-console-plugin/0.log" Jul 30 14:03:31.393729 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:31.393701 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nd8l9/perf-node-gather-daemonset-m7smw" Jul 30 14:03:31.529680 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:31.529652 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nd8l9/perf-node-gather-daemonset-m7smw"] Jul 30 14:03:31.532346 ip-10-0-133-230 kubenswrapper[2579]: W0730 14:03:31.532309 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9dd4614c_87ea_4fe9_add2_8bc6e7470c6c.slice/crio-1a5faa807462ec87c1a74e3be2b6b2f2db72caea8222075d2cd9d86d16440ae8 WatchSource:0}: Error finding container 1a5faa807462ec87c1a74e3be2b6b2f2db72caea8222075d2cd9d86d16440ae8: Status 404 returned error can't find the container with id 1a5faa807462ec87c1a74e3be2b6b2f2db72caea8222075d2cd9d86d16440ae8 Jul 30 14:03:32.109563 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:32.109528 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nd8l9/perf-node-gather-daemonset-m7smw" event={"ID":"9dd4614c-87ea-4fe9-add2-8bc6e7470c6c","Type":"ContainerStarted","Data":"41e50379da06a9b6c27651d022218d33316e18708e95eceb5d1308caa7576030"} Jul 30 14:03:32.110089 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:32.109590 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nd8l9/perf-node-gather-daemonset-m7smw" event={"ID":"9dd4614c-87ea-4fe9-add2-8bc6e7470c6c","Type":"ContainerStarted","Data":"1a5faa807462ec87c1a74e3be2b6b2f2db72caea8222075d2cd9d86d16440ae8"} Jul 30 14:03:32.110089 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:32.109652 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-nd8l9/perf-node-gather-daemonset-m7smw" Jul 30 14:03:32.125880 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:32.125821 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-nd8l9/perf-node-gather-daemonset-m7smw" podStartSLOduration=1.125803294 podStartE2EDuration="1.125803294s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 14:03:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 14:03:32.124132885 +0000 UTC m=+3859.955599024" watchObservedRunningTime="2026-07-30 14:03:32.125803294 +0000 UTC m=+3859.957269418" Jul 30 14:03:32.456447 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:32.456408 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-57684fd498-sd7hr_c091fcff-8a82-4546-b874-ab4e50b89183/console/0.log" Jul 30 14:03:32.491161 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:32.491126 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-cj5lq_30407988-1b56-4ecd-9756-1f503336e72f/download-server/0.log" Jul 30 14:03:34.021619 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:34.021596 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-598js_a34ce5ce-94cf-4ab0-923d-c12612130e0a/dns/0.log" Jul 30 14:03:34.045713 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:34.045685 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-598js_a34ce5ce-94cf-4ab0-923d-c12612130e0a/kube-rbac-proxy/0.log" Jul 30 14:03:34.192187 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:34.192159 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-x7bbz_a4d9b0b7-6474-457f-b742-05d47589d56f/dns-node-resolver/0.log" Jul 30 14:03:34.770215 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:34.770185 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9cpnl_8eca3445-f081-4f35-aa2c-603a2b80d815/node-ca/0.log" Jul 30 14:03:35.749498 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:35.749471 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-cch52_ed205912-55a1-484b-bf85-f76d5ceadfc7/istio-proxy/0.log" Jul 30 14:03:35.904320 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:35.904283 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-xz75p_86ada943-10c1-4872-85f2-1295a2e95aeb/discovery/0.log" Jul 30 14:03:35.988956 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:35.988909 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-jnmtt_900cf9c9-d235-48e9-b7e4-fc46e8e0b742/istio-proxy/0.log" Jul 30 14:03:36.015233 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:36.015134 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-jnmtt_900cf9c9-d235-48e9-b7e4-fc46e8e0b742/istio-proxy/1.log" Jul 30 14:03:36.114964 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:36.114936 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-57f58cdc8c-xn7bm_5703055a-5a1f-4546-bb90-1ca9d22e0933/router/0.log" Jul 30 14:03:36.966674 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:36.966645 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xzr5s_4c0375ad-3873-408c-95c6-4c826bb4629a/serve-healthcheck-canary/0.log" Jul 30 14:03:37.489602 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:37.489575 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bq2t2_7239b730-25c6-4df2-9c23-fb9ae5536bca/kube-rbac-proxy/0.log" Jul 30 14:03:37.508490 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:37.508464 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bq2t2_7239b730-25c6-4df2-9c23-fb9ae5536bca/exporter/0.log" Jul 30 14:03:37.527873 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:37.527831 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bq2t2_7239b730-25c6-4df2-9c23-fb9ae5536bca/extractor/0.log" Jul 30 14:03:38.125565 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:38.125539 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-nd8l9/perf-node-gather-daemonset-m7smw" Jul 30 14:03:40.789685 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:40.789611 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6bd55cb6f4-xcfbz_e7988f8a-ec3f-41fa-a517-9ca561628770/manager/0.log" Jul 30 14:03:40.809645 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:40.809624 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6bd55cb6f4-xcfbz_e7988f8a-ec3f-41fa-a517-9ca561628770/copy-manifests/0.log" Jul 30 14:03:41.540169 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:41.540090 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-cch52_ed205912-55a1-484b-bf85-f76d5ceadfc7/istio-proxy/0.log" Jul 30 14:03:41.676264 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:41.676234 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-xz75p_86ada943-10c1-4872-85f2-1295a2e95aeb/discovery/0.log" Jul 30 14:03:41.722890 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:41.722863 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-jnmtt_900cf9c9-d235-48e9-b7e4-fc46e8e0b742/istio-proxy/0.log" Jul 30 14:03:41.749696 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:41.749668 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-jnmtt_900cf9c9-d235-48e9-b7e4-fc46e8e0b742/istio-proxy/1.log" Jul 30 14:03:41.819060 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:41.818986 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-57f58cdc8c-xn7bm_5703055a-5a1f-4546-bb90-1ca9d22e0933/router/0.log" Jul 30 14:03:42.231809 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:42.231785 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-d8f5f8447-9kzh9_26760e0a-0c28-424b-bec4-f78d0f7b412f/manager/0.log" Jul 30 14:03:43.254693 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:43.254659 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-cch52_ed205912-55a1-484b-bf85-f76d5ceadfc7/istio-proxy/0.log" Jul 30 14:03:43.391375 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:43.391338 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-xz75p_86ada943-10c1-4872-85f2-1295a2e95aeb/discovery/0.log" Jul 30 14:03:43.444491 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:43.444459 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-jnmtt_900cf9c9-d235-48e9-b7e4-fc46e8e0b742/istio-proxy/0.log" Jul 30 14:03:43.472929 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:43.472901 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-jnmtt_900cf9c9-d235-48e9-b7e4-fc46e8e0b742/istio-proxy/1.log" Jul 30 14:03:43.554514 ip-10-0-133-230 kubenswrapper[2579]: I0730 14:03:43.554448 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-57f58cdc8c-xn7bm_5703055a-5a1f-4546-bb90-1ca9d22e0933/router/0.log"